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Unfair Employment Practices As Viewed by Private 
Employment Counselors * 


Vernon Keenan and Willard A. Kerr 


Illinois Institute of Technology 


American business and industrial leaders 
make rather free use of the terms “freedom of 
opportunity” and “free enterprise.” These 
terms have psychological meaning and signifi- 
cance; apparently they are generally accepted 
as integral parts of the American way of life. 
Yet, as in all cultures, there are dissonant ele- 
ments and contradictions. Sometimes the 
contradictions seriously weaken the working 
strength of a culture. It is possible that un- 
fair employment practices constitute a major 
inconsistency in the current American pattern. 
“Freedom of opportunity” has many implica- 
tions, and one of the most important is equal 
opportunity to compete for jobs. 

Psychologists should be interested in this 
problem. They alone among the scientists 
specialize in construction and use of the ob- 
jective instruments which are the obvious 
alternatives to consideration of race, creed, and 
ideology in the employment process. Their 
own job opportunities and opportunities for 
service to society are, in fact, restricted accord- 
ing to the extent to which selection and place- 
ment testing is mot institutionalized as a part of 
the industrial culture. This would seem to 
place the real interests of psychologists in fair 
employment practices at a level of professional 
self-interest and, therefore, not merely aca- 
demic or political. 

Examination of the psychological literature 
on the problem shows it to be either extremely 
sparse or only distantly relevant. Aside from 
the literature on attitudes and prejudice in 
social psychology (1, 2), the authors found few 

* This report was prepared from data gathered by 


means of a questionnaire constructed by Vernon Keenan 
while a student at the Illinois Institute of Technology. 
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references specifically on the problem of adult 
employment discrimination. One closely re- 
lated research by Saenger and Gordon (4) on 
504 representative residents of New York City 
indicated lower job satisfaction on the part of 
minority group members and still lower job 
satisfaction on the part of individuals who had 
personally experienced discrimination. 


Employment Counselors 


In speculating as to which occupational 
group has most insight into discrimination in 
employment, it was finally decided that coun- 
selors in private employment agencies were in 
the most strategic positions to obtain and re- 
port such confidential information. This 
seemed true because they handle primarily “the 
white collar” jobs, receive rather specific job 
orders from employers, and typically have a 
wide acquaintance with company employment 
officers. 

The Sample. Accordingly, a random sample 
of private employment counselors was drawn. 
The State of Illinois requires that each such 
counselor register annually with its Depart- 
ment of Labor. The current list for the 
Chicago area contained 738 counselors. Every 
third name was drawn for an. invitational 
sample, making a total of 246. Question- 
naires were mailed to these 246 counselors, but 
45 were returned unclaimed by the Postal 
Department. Of the remaining 201, 45 com- 
pleted questionnaires were returned (22 per 
cent). Although anonymous, information 
data show the obtained sample to be repre- 
sentative of the total list as to sex distribution 
(51 per cent male) and age (means: male 33, 
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female 26). Average experience was approxi- 
mately five years. Aside from these facts, it 
was not possible to make a more refined check 
on the representativeness of those responding. 

The Questionnaire. The two-page question- 
naire was preceded by a cover letter which 
stated that ‘‘As an employment counselor you 
have had an excellent opportunity to, ob- 
serve discrimination in hiring practices}and 
because of this we are asking you to assigt us 
in determining the ex/ent of such discrimina- 
tion. We are not interested in whether such 
practices are proper or improper. As much as 
you can, then, try to answer the questions as 
objectively as possible. Your frankness and 
cooperation in this survey will be deeply ap- 
preciated. After you have completed the 
questionnaire, please return it in the stamped 
envelope which is enclosed. DO NOT SIGN 
THE QUESTIONNAIRE. If you desire a 
report on the results of this survey, print your 
name and address on the enclosed postal card 
and mail it separately.” 

The questionnaire itself obtained informa- 
tion on age, sex, and counseling experience. It 
also inquired into the predominant occupa- 
tional level of job orders received, typical 
education of clients, and various aspects of 
discrimination. 


Results 


Ethnic Discrimination. As shown in Table 
1 wide differences are reported to exist in the 
difficulty of placing typical individuals of 
various ethnic groups even when all are equally 
qualified. Most difficult to place are Negroes. 
Next come Mexicans and Orientals. Of inter- 
mediate difficulty in placement are persons of 
Italian, Polish, and Slavic descent. Easiest 
to place are persons of Irish, English, and 
German descent. The range of difficulty in 
placement is suggested by the comparative 
facts that four-fifths of the counselors report 
Irish, English, and German applicants easy 
to place, whereas only two per cent report 
Negroes, Mexicans, and Orientals as easy to 

‘ The questionnaire has been filed with the American 
Documentation Institute. Order Document 3709 from 
American Documentation Institute, 1719 N Street, 
N.W., Washington 6, D. C., remitting $1.00 for micro- 
film (images 1 inch high on standard 35 mm. motion 


picture film) or $1.00 for photocopies (6X8 inches) 
readable without optical aid. 
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Table 1 


“How difficult is it to place persons of __ 
assuming that they are qualified?” * 


descent, 








Average Hard 
Diffi- to 
culty Place 


Ethnic 
Group 


Never 
Place 


Always Easily 
Place Place 


. Irish 31 51 13 
. English 38 47 
. German 3: 47 
. Slavic 33 
5. Polish 33 
6. Italian 38 
7. Oriental 4 
8. Mexican 
9. Negro 40 





* Frequencies of responses are reported as percent- 
ages. Their sums horizontally are not equal to 100 
because of the instances of “no reply.” 


place. Eighty-four per cent of the counselors 
reported Negroes as “hard to nlace”’ or ‘‘never 
place” even if qualified. 

The date of Table 1 resemble somewhat the 
Bogardus experience with “ distance”’ 
data; however, a slightly simpler explanation 
becomes apparent upon examination of the 
critical ratios of successive ethnic group ranks. 
The three easily placed groups (Irish, 
English, and German) are not significantly 
different among themselves in ease of place- 
ment according to these data. A second-level 
cluster (Slavic, Polish, Italian) of ethnic groups 
likewise do not differ significantly from each 
other in ease of placement. This is also true 
of the third level (Oriental, Mexican). How- 
ever, each group in any level does differ sig- 
nificantly in ease of placement from any group 
in any other level including the fourth level 
(Negro). The homogeneity of variance and 
over-all variance ratio were established as 
significant before critical ratios were deter- 
mined. 

Religious Discrimination. The per cent of 
counselors reporting major religious groups as 
“always place” or “easily place” if qualified 
were as follows: Protestant, 84; Catholic, 75; 
Jewish, 9. No counselor reported either 
Protestants or Catholics as “‘hard to place” or 
“never place” even if qualified, but 46 per cent 
stated this to be true of Jews. It seems from 


social 
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these data, at least in the Chicago area, that 
Jews are as difficult to place as are Orientals. 

Job Requirements. The counselors were 
asked “When arranging an interview for a 
client, how frequently are you asked to supply 
the following information?” The items of in- 
formation follow with the per cent of counse- 
lors reporting ‘‘always”’ or “‘most of the time”’: 
experience, 98; full name, 88; age, 84; personal 
appearance, 60; racial descent, 40; nationality, 
36; address, 26; religion, 25. 

They also were asked ‘“‘When discussing the 
rejection of an applicant with an employer, how 
frequently are the following mentioned as 
reasons for the rejection?”’ The reasons follow 
with the per cent of counselors stating either 
“always” or ‘“‘most of the time’”’: experience, 91; 
age, 22; appearance, 13; race, 8; religion, 4; 
nationality, 4; address, 2; name, 0. 

It appears from the first answers above that 
discrimination is specifically present in at least 
one-third of the job orders received by the 
counselors. However, this may _ underesti- 
mate the problem. One counselor appended 
the following typical note to her question- 
naire. ‘The job order contains two blanks 
Non-Nordic (Jew-Neg-Otien) & Nordic (Chris- 
tians) thus enabling our counselors to prevent 
the embarrassment of sending a Jew, etc. to a 
Nordic company. So the nationality-religion 
problem never enters as a reason for rejection.” 

The finesse with which discrimination is 
handled is illustrated by the ambiguous use 
of the term “‘personality”’ as shown by the 
statement of another counselor. ‘“‘It is taken 
for granted that in screening applicants for 
employment we will not recommend one 
whose personality or appearance is not accept- 
able. Experience gives counselors knowledge 
of types of applicants acceptable to company’s 
representative, and company’s representative 
a confidence in counselor’s recommendations.’ 

Size and Extensily of Firm. Whenasked “In 
your opinion, which of the following is most 
particular about the race or religion of job ap- 
plicants?” the counselor respondents replied as 
follows: small firms, 36; large firms, 33; 
medium-sized firms, 18; no reply, 13. The 
same type of judgment was requested for local 
and national organizations. ‘In your opinion, 
which of the following is more particular about 


363 


the race or religion of job applicants?” The 
per cents of respondents replying were as fol- 
lows: local, 47; nation-wide, 38; no reply, 16. 
These results are difficult to interpret, but are 
believed not to indicate any extreme unique- 
ness of discrimination as related to size and 
extensity of firm. 

Policy Origin. Who sets discriminatory 
policies? Although this study could not ob- 
tain detailed information on this question, the 
following aspects were investigated. ‘In 
your opinion, is selection by race and religion 
company policy, the personal policy of the 
personnel director, or the expressed wish of the 
employees?””. The per cents of counselors 
giving each cause are as follows: company 
policy, 53; personnel director, 22; employees, 
18; no reply, 7. 

Effect on Counselor. ‘Do you feel that any 
discrimination that does exist makes your job 
less difficult, more difficult, or about the 
same?”’ The distribution of replies was as fol- 
lows: more difficult, 67; about the same, 31; 
less difficult, 2. The older and more experi 
enced counselors were more prone to reply 
“about the same”’ to this question than were 
the younger counselors who more consistently 
replied ‘‘more difficult.” This is interesting, 
because replies to no other question were 
significantly related to age. 


Summary and Conclusions 


A sample of private employment agency 


counselors in the Chicago area was requested 


by mail to cooperate in a study of unfair em- 
ployment practices (22 per cent cooperated). 
The replies of the 45 respondents suggest the 
following tentative conclusions. 


1. According to the reports of these employ- 
ment counselors, the ethnic group which bears 
the severest brunt of job discrimination is the 
Negro; 84 per cent of the counselors report ex- 
treme difficulty in their placement “even if 
qualified.” 

2. The second cluster of ethnic groups in 
order of job discrimination experience includes 
the Mexicans and Orientals. 

3. The third cluster (less intense discrimina- 
tion) includes Slavs, Poles, and Italians. 
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4. The fourth cluster includes Irish, English, 
and Germans. 

5. Religious discrimination _ is 
largely against the Jews. 

6. Discrimination is reported as specifically 
apparent in at least one-third of the job orders 
received by the private agency counselors. 

7. A majority of counselors responding be- 
lieve unfair employment practices to be de- 
liberate company policy. 

8. Two-thirds of the respondents report 
that the “discrimination that does exist” 


directed 


makes their jobs more difficult. 

9. The hypothesis that private employment 
agency counselors can supply critical informa- 
tion about the operation of discrimination in 


Vernon Keenan and Willard A. Kerr 


employment appears, from these results, to 
be verified. 


Received January 16, 1952. 
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The Accuracy of Application Blank Work Histories 


James N. Mosel 


The George Washington University 


and 
Lee W. Cozan 


The Hechinger Company, Washington, D. C. 


Although work histories have long been a 
staple item in employment procedures, the 
accuracy with which such data are reported by 
the applicant has received remarkably little 
systematic quantitative investigation. The 
only adequate study is the recent work of 
Keating, Paterson, and Stone (4). These in- 
vestigators studied the accuracy of three work 
history items (wages, length of previous em- 
ployment, and job duties) obtained by coun- 
seling interviews. By correlating worker 
claims with records of previous employers, it 
was found that applicant reports were sur- 
prisingly accurate for both recent and remote 
employment, the correlations ranging from 
.90 to .98. 

The most usual method, however, for ob- 
taining data on previous employment is 
through a written questionnaire—the applica- 
tion blank in industry and Form 57 or ‘‘unas- 
sembled examination” in government. While 
the literature of personnel psychology contains 
numerous studies of the utility of such data to 
predict job success, the accuracy of the ap- 
plicant’s responses has apparently received 
little attention. It would appear hazardous 
to project the findings of Keating ef a/. to the 
application blank inasmuch as these results 
were obtained by interview and in a counseling 
situation where there was presumably little in- 
centive to distort. 

A survey of the literature reveals for the 
most part only “incidents” rather than system- 
atic quantitative investigation of this ques- 
tion. The cases mentioned by Moore (6) are 
conventionally cited in this connection. In 
the army during World War I, it was found 
that only six per cent of those claiming to be 
skilled in a particular trade actually had ade- 
quate skill, while over 30 per cent proved 


totally inexperienced (“trade bluffers’’). The 
U. S. Civil Service Commission reported that 
over 0.3 per cent of the applicants in one year 
~vere barred for attempting to deceive the Com- 
mission. Among applicants for a position in a 
city department in New York, two per cent 
were found to have criminal records although 
they had sworn in their applications that they 
had none. 

More recently, Lipsett (5) reports that in 
the Second Civil Service Region, 46 per cent of 
the cases subjected to a field investigation re- 
vealed falsification in the application for em- 
ployment. In an unpublished study, Goheen 
and Mosel (2) found that of 69 civil service ap- 
plicants for the job of traffic and transporta- 
tion clerk, about ten per cent submitted inac- 
curate statements concerning previous job 
duties. Seven per cent of these were favorable 
to the applicant, while only three per cent in- 
volved misstatements of major importance. 

With military personnel, however, Harris 
(3) found that only rarely do individuals falsify 
on certain items pertaining to previous psychi- 
atric experiences. In fact, he found a tendency 
to over-report such occurrences. As a conse- 
quence, Conrad and Ellis (1) suggest that 
military personnel may provide personal his- 
tory information with greater accuracy than 
civilians ordinarily do. 

Parten (7) has reviewed the scant literature 
on the test-retest reliability and the accuracy 
(as judged by objective records) of such 
personal data as age, car and telephone owner- 
ship, etc., as obtained in public opinion and 
market research. the 
vicinity of .90 and percentages of agreement 
were generally in the 80’s. 

The significance of the accuracy of applica- 
tion blank work histories is twofold. In the 


Correlations were in 





366 


first place, accuracy of response imposes a 
limit upon the potential utility of such data in 
predicting job success (assuming that there is 
no correlation between job success and the di- 
rection of distortion). Secondly, the amount 
of distortion would be an important determi- 
nant of the necessity of a second selection aid— 
the recommendation questionnaire or reference 
check. The primary (and perhaps only) value 
of this device is that it provides verification of 
the assertions in the application blank. Veri- 
fication may contribute to the predictive 
validity of the application blank by providing 
a more adequate basis from which predictions 
could be made. Furthermore, the amount of 
distortion uncovered may in itself serve as a 
revealing consideration in applicant evaluation. 

The purpose of the present investigation is 
to present some much needed evidence on the 
accuracy of work history data obtained by the 
application blank in a setting where distortion 
might be expected to occur, i.e., the usual 
industrial employment situation. In 
ducting such a study, it is essential to deter- 
mine not only the frequency of errors but also 
the magnitude. To this end, the technique of 


con- 


correlational analysis employed by Keating 


ef al. was used. 
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Procedure 


The application blanks studied were those 
submitted over a one-year period to the person- 
nel department of a building supply and 
engineering company. These applications 
were for sales and office positions and included 
the usual information on nature of previous 
experience, dates of employment, weekly 
salary, and the names and addresses of previ- 
ous empl@yers for each job held. The appli- 
cants were not informed that their statements 
would be subjected to verification, although 
it must be assumed that at least some expected 
a reference check to be made. 

Three items of work history were submitted 
to verification: weekly salary, duration of em- 
ployment, and job duties. Verification was 
achieved in a few cases of a local nature by 
telephone check, but the majority required a 
mailed questionnaire or recommendation form. 
The return rate on this questionnaire was ap- 
proximately 95 percent. Further checks were 
made in many cases through a credit bureau. 
In making these inquiries, the former employer 
was not informed of the applicant’s claims; 
rather he was requested to submit the desired 
information without such knowledge. This 
was done to prevent the former employer from 
“verifying” applicant claims without actually 


Table 1 


Relationship between Claimed and Verified Weekly Wage for 61 Male Applicants on Jobs Held 
0-12 Months Prior to Application for Employment 
r= 93 


Claimed 
Wage 


$10-19 


20-29 30-39) =640-49 
1004 
90-99 
80-89 
70-79 
60-69 
50-59 
40-49 
30-39 
20-29 
$10-19 


Total 


50-59 


Verified Weekly Wage 


100 and 
70-79 80-89 Over 


60-69 90-99 


1 oi a 
| 
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Table 2 


Relationship between Claimed and Verified Weekly Wage for 65 Female Applicants on Jobs Held 
0-12 Months Prior to Application for Employment 


r= 94 








Verified Weekly Wage 


Claimed 


Wage $20-29 30-39 4049 50-59 60-69 





80-89 
70-79 
60-69 
50-59 
40-49 
30-39 
$20-29 


Total 


checking the records and from “giving the ap- 
plicant a break’’ by refusing to disclose falsifi- 
cations. 

Data on 61 men and 65 women were suffi- 
ciently complete to permit analysis. In order 
to investigate the possibility that memory dis- 
tortion might operate differentially in terms of 
the recency with which the jobs were held, 
accuracy was studied separately according to 
remoteness in time. The time interval cate- 
gories were identical with those adopted by 
Keating ef al., i.e., a 0-12 month category 
which included all jobs terminated one year 
prior to applying for the present employment; 
a 13-24 months category which included all 
jobs terminated from 13 months to two years 


Total 


2 


before applications; and soon. Work histories 
of male and female applicants were analyzed 
separately to uncover any sex differences. 


Results 

Data were analyzed and displayed in the 
same manner as used by Keating ef a/. in 
order to afford a comparison of results. 

One-Year Time Interval. A scattergram of 
the relationship between claimed and verified 
weekly wage on jobs held 0-12 months prior to 
application for employment is shown in Table 1 
for males and in Table 2 for females. The 
correlation is .93 for men and .94 for women. 

The scattergrams for duration of employ- 


ment are shown in Tables 3 and 4. The cor- 


Table 3 


Relationship between Claimed and Verified Duration of Employment ‘or 61 Male Applicants on 
Jobs Held 0-12 Months Prior to Application for Employment 
r= .98 


Claimed - --————- 
Duration 
(in months) 0-9 


10-19 
50 and over 
40-49 
30-39 
20-29 
10-19 
0-9 


Total 


20-29 





Verified Duration (in months) 


50 and 


30-39 40-49 Over 
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Table 4 


Relationship between Claimed and Verified Duration of Employment for 65 Female Applicants on 
Jobs Held 0-12 Months Prior to Application for Employment 


f= 


Claimed sii tiie 
Duration 


(in months) 0-9 10-19 


50 and over 
40-49 
30-39 
20-29 
10-19 

0-9 


Total 


relation between claimed and verified duration 
is .98 for both male and female applicants. 

Not shown graphically is the relationship 
between claimed and verified job duties. 
Agreement was found in 95 per cent of the 
male cases and in 94 per cent of the female 
cases. 

Longer Time Intervals. The correlation be- 
tween claimed and verified wages for all jobs 
held over 12 months prior to application for 
employment was .91 for the male cases and 
.90 for the female cases. Table 5 shows the 
correlations for each specific time interval 
category within this longer period. Because 
the number of cases in each interval is so 
smail, considerable reservation must be held 
in using these coefficients to estimate the cor- 
relations in the population. It is clear, how- 


Table 5 


Correlations between Claimed and Verified Weekly 
Wage for Male and Female Applicants on Jobs Held 
at Time Intervals Greater than One Year 
Prior to Application for Employment 


Time Interval 
(Job termination date Men Women 
prior to application —_ 
for employment) N I r 
13-24 : 94 
5-36 d 98 
7-48 ; 89 
60 

61 and over j .90 


20-29 30-39 40-49 


98 


Verified Duration (in months) 


50 and 
Over Total 


— 


“13 | 


mm NM NR & WS-} 


we 


— 
on 


ever, that in the present sample, there is no 
indication of a relationship between accuracy 
of response and the recency of the employment 
reported, nor of any sex difference. 

The correlation between claimed and veri- 
fied duration of employment for the longer 
time interval was .97 for male applicants and 
.87 for the female applicants. Correlation 
coefficients for each specific time interval are 
shown in Table 6. Here again there appears 
no evidence of decreased accuracy for the less 
recent jobs, nor is there any indication of a 
sex difference. 

As for job duties, agreement between appli- 
cant claim and employer report was found in 
84 per cent of the male applicants and in 87 
per cent of the female applicants. 


Table 6 


Correlations between Claimed and Verified Duration of 
Employment for Male and Female Applicants on 
Jobs Held at Time Intervals Greater than One 

Year Prior to Application for Employment 


Time Interval 
(Job termination date 
prior to application 

for employment) N N r 


— 91 


Men Women 


and over 
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Inspection of the above tables brings out 
two additional observations: 1. Of the rela- 
tively few distortions that do occur, the great 
majority are in the direction of overestimation 
and hence in the applicant’s favor. This was 
not apparent in the data of Keating ef a/. 2. 
For the more recent employment, wage claims 
are somewhat more susceptible to distortion 
than are claims concerning duration of em- 
ployment. This difference was not apparent 
for the more remote jobs. These same re- 
lationships also hold for the data of Keating 
etal. The fact that items have a differential 
susceptibility to distortion is further sup- 
ported by the study by Goheen and Mosel (2) 
on traffic and transportation clerks. Ten per 
cent of these applicants gave advantageously 
inaccurate replies to the item “reasons for 
separation”; seven per cent on job duties; 


and one per cent on wages. 


Summary 


The present study was undertaken to deter- 
mine the accuracy of work history data as 
contained in the applications for employment 
submitted to a building supply and engineering 
company. High agreement was found be- 
tween applicant claims and verifications by 
past employers with respect to weekly wages, 
duration of employment, and job duties. All 
correlations except one were .90 or greater. 
Furthermore, there was no evidence of a re- 
lationship between validity of claim and re- 
cency of job; nor was there any apparent sex 
difference. 

There was, however, a difference in the sus- 
ceptibility to distortion of items for the more 
recent jobs. Wages were more subject to mis- 
statement than was duration of employment. 
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These results are in very close agreement 
with the findings of another study in which the 
same items were obtained by counseling inter- 
view. It might have been expected a priori 
that the employment situation of the present 
study would have encouraged greater distor- 
tion than the counseling interview. This, 
however, does not seem to be the case. Ap- 
parently, the implied verification of application 
data in the employment situation is a sufficient 
deterrent to distortion to provide an accuracy 
comparable to that which the counseling situ- 
ation achieves through lack of incentive to 
distort. One point of difference, however, 
was noted. In the present study distortions 
tended markedly in the direction of over- 
estimation, a trend not found in the study of 
the counseling interview. It may well be 
that the two situations differ not so much in 
amount of work history distortion as in the 
direction of distortion. 


Received November 27, 1951. 
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The Relationship between the Predictive Power of Aptitude Tests 
for Trainability and for Job Proficiency 


C. W. Brown and E. E. Ghiselli 
University of California, Berkeley 


The success of workers has been measured in 
a variety of ways, but it is possible to distin- 
guish at least two broad categories of criteria, 
namely, success in training and degree of job 
proficiency achieved after training. In many 
instances it is difficult to clearly differentiate 
between these two types of criteria. For ex- 
ample, on some jobs the worker receives his 
instruction quite informally, and if his success 
is measured in terms of production any differ- 
entiation between the learning period and the 
post-learning period is purely arbitrary. Fur- 
thermore, for certain jobs longitudinal studies 
of worker proficiency indicate continued im- 
provement over a period of years and, there- 
fore, it is hard to say just where the learning 
period terminates. 

Nevertheless, it is often feasible to make a 
distinction between trainability and level of 
job proficiency as measures of worker success, 
and ordinarily such a differentiation is made. 
Examples of training criteria are grades earned 
in formal training courses and instructors’ or 
supervisors’ ratings of worker progress during 
the learning period. Job proficiency has been 
measured in a variety of ways including speed 
and amount of production, achievement tests, 
supervisors’ ratings, and the like. 

Knowing that at least a rough distinction 
can be made between these two classes of 
criteria, we can consider a further problem. 
Only infrequently is attention paid to whether 
the types of abilities important in learning the 
skills and knowledges required for a job are 
the same as those that are important for 
performance after these skills and abilities 
have been acquired. Undoubtedly, few people 
would hold that they are identical, although 
most would expect considerable communality. 
The question arises: Can measures in one of 
these areas (learning or job proficiency) be 
used to predict success in the other area? 

Obviously, the nature of the index utilized 
to measure success in learning and the index 


used to measure job proficiency may differ 
considerably. Thus, in the training of welders 
their improvement might be measured in terms 
of performance on work sample tests, while the 
success on the job itself might be gauged in 
terms of supervisors’ ratings. In this case, an 
aptitude test which forecasts the learning 
criterion to a particular degree might be ex- 
pected to forecast the job proficiency criterion 
to a somewhat different degree. Nevertheless, 
it would be expected that a test which had no 
validity for the one criterion would at best 
have low validity for the other, and a second 
test that had high validity for the one would 
be at least moderately valid for the other. 

In other words, one would expect to find a 
positive correlation of at least moderate magni- 
tude to hold between the validity coefficients 
of various tests determined on the basis of 
their predictive power for training and their 
predictive power for proficiency. Indeed, 
knowing that scores on a test are related to 
trainability of workers for a particular job to 
a particular degree one is very likely to 
generalize to the conclusion that it has ap- 
proximately the same validity for predicting 
proficiency, and vice versa. The purpose of 
the present paper is to investigate this hypothe- 
sis that there is a substantial correspondence 
between the degree to which a test is valid in 
the prediction of trainability and the degree 
to which it is valid in predicting job profi- 
ciency. 

Methods and Procedure 

The present writers have developed a file of 
investigations conducted in the United States 
since 1919 relative to the validity of tests. In 
this file tests and occupations are classified by 
type. It is possible, then, to obtain a sum- 
mary of the findings concerning the validity a 
particular type of test has for a particular 
occupation either with respect to training or 
with respect to job proficiency. In summariz- 
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ing such a validity we have computed the 
weighted mean validity coefficient through 
Fisher’s z’ transformation. We have con- 
sidered the shortcomings of this procedure 
elsewhere.! 

Our approach, then, is to take as the index of 
validity the average of the validity coefficients 
found in previous studies. Thus, ideally, for 
each type of test and for each type of job we 
would have the average validity coefficient in 
the prediction of trainability and the average 
coefficient in the prediction of job success. 
Unfortunately, the data available from pre- 
vious investigations are incomplete and, there- 
fore, we do not have a pair of validity co- 
efficients for each type of test for each type of 
occupational group. Hence, the comparisons 
and relationships given in this report are not 
as complete as would be desirable. 

The classification of tests which we have 
employed is given below. Detailed descrip- 
tions of the various rubrics are to be found in 
the previously mentioned report. 

Intellective: Intelligence, Immediate memory, 
Substitution, and Arithmetic; Speed of Per- 
ception: Number comparison, Name com- 
parison, Cancellation, and Speed of perception; 
Spatial: Pursuit, Location, Tracing, and Spa- 
tial relations; Motor: Tapping, Dotting, Finger 
dexterity, Hand dexterity, and Arm dexterity; 
and Mechanical Principles. 

The categories into which all jobs were 
classified are as follows: Clerical Occupations: 
General clerks, Recording clerks, and Comput- 
ing clerks; Protective Service Occupations; 
Personal Service Occupations; Vehicle Opera- 
tors; Trades and Crafts: Mechanical repairmen, 
Electrical workers, Structural workers, Proc- 
essing workers, Complex machine operators, 
and Machining workers; and Manipulative and 
Observational Occupations: Machine tenders, 
Bench workers and assemblers, Inspectors, 
Packers and wrappers, and Gross manual 
workers. 

Results 

All data pertinent to the present problem 
are given in Table 1. The first question con- 
cerns the degree of relationship obtaining be- 

' Ghiselli, E. E., and Brown, C. W. Validity of 


aptitude tests for predicting trainability of workers. 
Personnel Psychol., 1951, 4, 243-260. 


Table 1 


Relationships between Validity Coefficients of Tests 
Used in the Prediction of Trainability and of 
Job Proficiency, together with Median 
Differences between Coefficients 


r Median 
between Difference 
Validity between 

Coeffi- Coeffi- 
cients cients 





Type of Test 
Intellective 33 , ll 
Speed of Perception : 43 
Spatial k ‘ 07 
Motor ; 07 

Type of Job 
Clerical 
Trades and Crafts 
Manipulative and 

Observational 

All Tests and Jobs 


tween the validity coefficients for the two types 
of criteria. Taking all tests and jobs together, 
a total of 127 pairs of validity coefficients were 
available. For these cases the coefficient of 
correlation was found to be .17.. The second 
column of the table presents coefficients by 
type of test and type of job. It will be noted 
that for these various breakdowns the re- 
lationship is of about the same order. It is 
apparent from these data that the relationship 
between the validity coefficients of tests for 
trainability and their validity for job profi- 
ciency is low. There is only a slight tendency 
for a test that proves useful in predicting 
trainability also to be useful in predicting job 
proficiency, and vice versa. 

In the final column of the table are given the 
medians of the differences between the validity 
coefficients for the two types of criteria. 
Taking all tests and jobs together the median 
difference between the coefficients is .10. 
While at first glance this difference may not be 
considered particularly large, it is to be re- 
membered that the validity coefficients for 
separate tests are seldom found to be over .50. 
Therefore, in general, the median difference is 


about one-fifth of the effective range of validity 


Reference to the median differ- 
ences for breakdowns of the individual tests 


coefficients. 
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and jobs as given in Table 1 indicate that they 
do not vary significantly from the median 
value for the total set of data. 


Discussion 

The findings herein presented indicate that 
only a low relationship exists between the 
validity of tests in the prediction of train- 
ability and in the prediction of job proficiency. 
That is, a test which is found to have high 
validity in the prediction of workers’ capacity 
tO learn a job may have relatively little 
validity in predicting how well they will per- 
form on that job after their training has been 
accomplished. results that 


These suggest 


the abilities important for learning a job may 
differ markedly from those important in the 
maintenance of proficiency on the job. 


C. W. Brown and E. EF. Ghiselli 


There are, of course, a number of laboratory 
investigations indicating that the abilities in- 
volved in the early stages of learning a task 
differ from those involved in later stages. It 
seems likely that a similar situation would 
exist with respect to an industrial task. How- 
ever, it would be hazardous to draw this con- 
clusion on the basis of the present analysis 
since the coefficients here utilized are subject 
to some distortion due to such factors as un- 
reliability of criteria and restriction of range 
of talent. In any event it is clear that one 
cannot be at all secure in using a test that has 
been validated against training criteria as a 
basis for forecasting job proficiency, or in 
using a test validated against job proficiency 
criteria as a basis for forecasting success in 
training. 


Received December 6, 1951. 





Validation of a Clinical Approach to the Placement of Engineers 


Ross Harrison* and Theodore A. Jackson 


Stevenson, Jordon and Harrison, Inc., New York City 


While there have been innumerable validity 
studies which correlate batteries of psycho- 
logical tests with job proficiency criteria and 
while there have also been many attempts to 
predict the achievement of students in en- 
gineering school from psychometric measures, 
the technical literature is singularly unre- 
warding on the subject of predicting job suc- 
cess of engineers in industry. The present 
note is a report on a personnel evaluation 
program with mechanical engineers in the 
Wright Aeronautical Division of the Curtiss- 
Wright Corporation.' 

Usually articles on the validity of personnel 
selection procedures are primarily statistical 
studies which relate batteries of tests to meas- 
ures or ratings of job adjustment. In recent 
years it is being realized in some quarters that 
a strictly psychometric or statistical approach 
to occupational prognosis is limited because it 
ignores psychological characteristics which, 
while not directly measurable, are neverthe- 
less important and may be evaluated. The 
use of multiple correlational methods with 
professional, sales, and executive personnel is 
less rewarding because the tests that make up 
the batteries deal more with cognitive abilities 
and do not adequately represent personality 
dimensions. Furthermore, such an approach 
neglects not only intrapersonal dynamics but 
also the integration of segmental information 
about the individual which is necessary for 
understanding the probabilities of job success. 
The global or holistic methods of clinical psy- 
chology such as projective techniques and 
depth interviewing allow for greater synthesis 
relevant data, whether qualitative 
quantitative, and are coming into wider use in 
personnel selection 
working in the industrial area. 


of or 


by some _ psychologists 
The usual 

* Hunter College. 

1 We are grateful to Messrs. G. R. Heil and P. R. 
Jackson of the Engineering Department for expediting 
the study. Mr. J. L. Altenhaus was responsible for 
most of the computations 
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objection to the clinical approach is that it is 
not objective and cannot be properly validated 
and hence is not scientifically acceptable. The 
rejoinder is that, while it is true that clinically 
oriented psychologists seem less inclined to 
validate their procedures in a rigorous manner 
and while the clinical methods are admittedly 
subjective, the effect of applying these methods 
can be objectively and empirically validated. 
In a small way we hope, in this article, to 
contribute to the validation of clinical pro- 
cedures in industrial placement. At the same 
time we realize that, because of practical con- 
siderations, our methods of validation are 
lacking in methodological refinement. 


Procedure 


The population was made up mostly of re- 
cent graduate engineers who had not yet been 
assigned to stable positions within the En- 
gineering Department. In the evaluation 
program each engineer was studied by means 
of a personal history form and a clinical inter- 
view as well as with a battery of ability, 
aptitude, interest, and personality tests. Dur- 
ing the course of the interview, which was 
primarily diagnostic in nature, the test findings 
were communicated to the engineer for his in- 
formation and guidance. Test evaluation was 
qualitative with every source of information 
considered in relation to all other relevant 
data. Emphasis was placed on patterned re- 
lationships and not on discrete scores or seg- 
mental behavior. Eventually a confidential 
written report, which included an analysis of 
abilities, interests, persona! traits, placement 
recommendations, and developmental poten- 
tialities for each man, was submitted to the 
technical administrators who were responsible 
for assignment. 

The evaluative techniques were as follows: 
Wonderlic Personnel; Shipley-Institute of Liv- 
ing Vocabulary and Abstract Reasoning; Otis 
Arithmetic Reasoning; Bennett Mechanical 
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Comprehension (Form BB); DAT Space Re- 
lations; Strong Vocational Interest Blank; 
Thematic Apperception Test (8 picture abridg- 
ment); personal history form; personality 
questionnaire; and a projective verbal situ- 
ations test. The last two tests and the per- 
sonal history form were custom-made for our 
purposes and are not on the market. The 
Engineering and Physical Science Aptitude 
Test of Moore, Lapp, and Griffin was tried out 
on a small sample but had to be abandoned 
because it did not discriminate sufficiently for 
our highly selected population. Some of the 
other ability tests had ceilings which were 
short of ideal, but none was so low as to pre- 
clude fairly adequate discrimination for practi- 
cal purposes. 

Because many of the personality tests were 
not scoreable and because of the integrative 
nature of our procedures, orthodox correla- 
tional methods could not be employed. A 
further difficulty was that no comprehensive 
merit ratings over an extended period were 
available on the engineers. Hence, it 
necessary to develop other, if less familiar, 
methods for testing out the validity of our 
approach. 

First method. In the first phase of the 
validation the personnel evaluation reports of 
113 mechanical engineers were compared with 
subsequent job performance. The immediate 
supervisors of the engineers, who with rare 
exceptions had not had occasion to consult the 
reports, were asked to compare the personal 
descriptions and predictions therein with actual 
job behavior as they knew it from daily con- 
tact. Criteria for selecting the reports to be 
validated were twofold: (1) the psychologist’s 
may eginnnee must have been followed; 
and (2) the supervisor was required to have at 
least p i months’ close observation of the 
man being rated. A member of the Engineer- 
ing Department decided whether the recom- 
mendations had been followed or not. 

The supervisor, after reading the report in 
each case, was requested to check one answer 
for the following question: 


was 


“From your experience with this man, would 
vou say that you agree with the desc riptions 
and findings contained within the report? 
High degree of agreement predominant 
agreement or mostly agree ; slight agree- 
ment ; no agreement a 


Ross Harrison and Theodore 


A. Jackson 


Second method. A complementary  ap- 
proach was made to validation by seeking the 
opinions of higher echelon administrators who 
were responsible for placement. These were 
the directors and division managers who had 
had approximately a year and a half experi- 
ence with the evaluation program. 
were three main questions: 


There 


“In your experience with the personnel 
evaluation reports, to what extent have you 
found them generally helpful and accurate? 
Very helpful and accurate ; fairly helpful 
and accurate ; somewhat helpful and accu- 
rate ; not at all helpful nor accurate 4 

* ‘Compare the testing program with the 
placement procedures that existed before test- 
ing was initiated. Has the testing program 
added anything useful or improved in any way 
the placement of engineers? The testing pro- 
gram is: A marked improvement in procedure 

; a slight improvement _; no improve- 
ment ; would prefer to dispense with it 
and re ‘ly on trial and error alone - ; 

3. “Did your attitude become more or less 
favorably disposed to the personnel evaluation 
reports as you became better acquainted with 
them and made use of them? More favorable 

; less favorable ___; unchanged Be 


In each instance comments were encouraged. 
In addition, there was a question about the 


approximate number 
administrator had read. 


of reports that each 


Results 


Recommendations. Some interest revolved 
around the question of the degree to which 
directors and division managers followed 
placement recommendations contained in the 
evaluation reports. No useful purpose would 
be served if the psychologists were academi- 
cally correct but were operating in a vacuum 
with their recommendations being largely 
ignored. 

In 28 per cent of the cases the findings with 
regard to disposition were ambiguous. When 
the ambiguities were disregarded and con- 
sideration was given only to those cases where 
a fairly sharp affirmative or negative decision 
was possible, it was found that 78 per cent of 
the recommendations had been followed. Be- 
cause of personnel requirements of different 
groups within the Engineering Department, it 
would not be reasonable to expect that recom- 
mendations could always be followed. 
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First method. Table 1 gives the results on 
the extent of agreement between the reports 
and the judgment of first-line supervisors 
based on their experience with the men who 
had been evaluated. Agreement was sub- 
stantial and was greater than had been antici- 
pated from a knowledge of possible attenu- 
ating factors. The criterion itself was subjec- 
tive and hence subject to human error. Even 
when follow-up investigations were carried out 
in cases of evident contradiction, it was fre- 
quently hard to determine whether the error 
lay with the psychological evaluation or with 
the supervisor’s judgment or was due to 
semantic problems of communication or to un- 
usual environmental conditions which might 
obscure the working out of the personal 
qualities reported in the evaluation. There 
can be no doubt, however, that in some in- 
stances the evaluations themselves were in 
error. 

Second method. A tabulation of the opinions 
of the directors and division managers is 
presented in Table 2. The results are favor- 
able but than for the more direct 
method of validation. 

When the administrators were asked to 
what degree they had found the reports 
helpful and accurate, about three-quarters 
answered jin the first two (or favorable) cate- 
gories. No one said that the reports were 
valueless. 

On the second question, which compared 
the evaluation program with the placement 
procedures that existed before testing was 
initiated, practically all the respondents agreed 
that there was some improvement. They 
were evenly divided as to the amount of agree- 
ment—whether ‘“‘marked” or “slight.” 

In response to the third question, which was 
concerned with attitudinal changes to the 


less so 


Table 1 


Agreement between Evaluation Reports and Ratings 
by Supervisors of 113 Engineers 


Per Cent 


Degree of Agreement 


39.8 
51.3 
Slight agreement 7.9 
No agreement 9 


High degree of agreement 


Predominant agreement or mostly agree 


Table 2 


Percentage Distribution of Ratings by Directors and 
Division Managers on the Personnel 
Evaluation Program 

Question 1. (N = 24) Per Cent 
Very helpful and accurate 6.5 
Fairly helpful and accurate 
Somewhat helpful and accurate 
Not at all helpful and accurate 

Question 2. (N = 21) 

A marked improvement in procedure 
A slight improvement in procedure 
No improvement 

Question 3. (N = 25) 
More favorable attitude 
Less favorable 
Unchanged 


program, 64 per cent were more favorably im- 
pressed with added experience, 8 per cent be 
came more negative, while 28 per cent re- 
ported no change. Of those who reported no 
change, many had favorable attitudes from the 
beginning. 

Information was available on the number 
of reports that each administrator had read 
for assignment purposes. An attempt was 
made to find out if reaction to the program 
was related to familiarity with reports. 
Further statistical computations, which will 
not be reported here, were made to determine 
the relationship. The resulting figures showed 
that for the first two questions those adminis- 
trators who were more familiar with evalu- 
ation reports were also more favorably dis- 
posed to psychological testing, but this same 
relationship did not hold for the third question. 

The solicited comments of the directors and 
division rmhanagers were highly diversified and 
showed only one definite trend. The ma- 
jority of the remarks were concerned with 
administrative aspects of the evaluation pro- 
gram rather than with the content of the re- 
ports themselves. Since these remarks were 
frequently critical, this fact served to attenuate 
the validity figures. Critical comments about 
the administrative use to which the reports 
were put somewhat confused the issue, since 
the basic problem was the validity of the 
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evaluations, not the way in which they were 
used. Moreover, many of the administrative 
problems were a consequence of the shortage 
of engineers and therefore beyond control. 


Summary 


A clinical approach to the evaluation and 
placement of engineers in the aeronautical 
industry is described. Validation was studied 
in two ways. 

1. First-line supervisors rated the accuracy 


Ross Harrison and Theodore A. Jackson 


of psychological reports on the basis of their 
experience with the men who had been evalu- 
ated. Substantial agreement was obtained 
in over 90 per cent of the cases. 

2. Higher echelon administrators, respon- 
sible for assignment, after a year and a half 
experience gave their opinions on the value of 
the program. The results were again favor- 


able but were slightly less so because of ad- 
ministrative complications. 


Received August 4, 1952. 
Early publication. 





Relationship of Masculinity-Femininity to Tests of Mechanical 
and Clerical Abilities * 


Marilyn C. Lee 


University of Illinois 


The primary purpose of this investigation 
was to study relationships between aptitude 
and personality variables with specific refer- 
ence to mechanical ability, clerical ability, and 
masculinity-femininity. A secondary purpose 
was to explore the possibility of developing a 
disguised and relatively non-fakable measure 
of M-F from clerical and mechanical test 
materials. 

The rationale for this study is based on con- 
sistent findings reported in the literature indi- 
cating that women tend to score higher than 
comparable groups of men on tests of clerical 
aptitude (5, 6, 11), while men perform better 
than women on most tests of mechanical 
ability (3, 10, 13). It should be emphasized 
that these ability differences are reported in 
reference to the biological dichotomy of males 
and females. Are such differences also re- 


flected in the psychological continuum of 
masculinity-femininity as measured by an 


inventory of interests, attitudes, and modes of 
behavior? 
Tests and Subjects 


The tests administered for the purposes of 
this study included the Bennett Test of Me- 
chanical Comprehension, Form AA, the Min- 
nesota Clerical Test, and the Terman-Miles 
Attitude-Interest Analysis Test, Form B. 
The Bennett and Minnesota tests were 
selected because they have repeatedly shown 
substantial sex differences, and are of an ap- 
propriate difficulty level for the sample 
utilized; the Terman-Miles inventory was used 
because it rep:esents one of the most compre- 
hensive and carefully constructed inventories 
yet developed for the measurement of mascu- 
linity-femininity. Since performance on these 
tests is related in varying degrees to perform- 
ance on measures of general academic ability 
(1, 2, 14), available scores on the American 


* This article is based on the writer’s M.A. thesis of 
the same title, completed in December, 1950 under the 
direction of Prof. Donald G. Paterson, and on file in 
the University of Minnesota Library. 
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Council on Education (ACE) Test for College 
Freshmen were also utilized in the analysis. 

The experimental group comprised 102 male 
and 72 female students recruited from a sopho- 
more level course in psychology at the Univer- 
sity of Minnesota. Biographical information 
obtained for all subjects from questions pref- 
acing the Terman-Miles test indicated that 
the sample was quite uniform with respect to 
regional background, the great majority being 
local residents. The mean ACE score of the 
group was at the 63rd percentile on national 
college freshman norms. 


Results 


Inter-Sex Differences. Means and standard 
deviations of the four test variables are pre- 
sented separately for the male, female, and 
combined groups in Table 1. These results 
corroborate previous research in showing that 
men as a group perform significantly better 
than women on the Bennett Test of Me- 
chanical Comprehension (C.R.= 10.7), while 
women are significantly superior to men on the 
Minnesota Clerical Test (C.R.=3.6). The 
sharp sex-differentiating power of the Bennett 
test is evidenced by the relatively small over- 
lap (21.7%) of the male and female score 
distributions. Although the Minnesota Cleri- 
cal Test also succeeds in dichotomizing the 
sexes, it is less efficient in this respect than the 
Bennett, as indicated by the larger score dis- 
tribution overlap of 45.9%. The superior 
differentiating ability of the mechanical test 
may be at least partially attributable to its 
greater amenability to cultural influence. 

By way of comparison, the Terman-Miles 
Attitude-Interest Analysis Test separated 
males and females with a percentage overlap 
of only 9.7, an amount comparable to the 8% 
average overlap obtained by the test authors 
for total scores on this test (14). Results for 
the ACE test bore out expectations based on 
previous research (15) that there would be no 
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Table 1 


Means and Standard Deviations for the Four Test Variables 





(N = 102) 


Test 
Bennett Mech. Compr. Test, 
Form AA 
Minn. Clerical Test 
Terman-Miles Att.-Int. 
Form B 
ACE Psychol. Exam.* 


Anal. Test, 
+88.9 
87.2 


are as follows: males, 84; females, 58; total group, 142. 


statistically significant differences between the 
sex groups in performance. 

Product moment correlations of the Terman- 
Miles test with each of the three other test 
variables are presented for the total group and 
for each sex separately in Table 2. In refer- 
ring to this table it should be noted that plus 
on the Terman-Miles test indicate 
masculinity and minus scores indicate femi- 
ninity. Thus, positive correlations between 
M-F and other test scores represent a positive 
relationship with masculinity and a negative 
relationship with femininity, the relationships 
being reversed for negative coetiicients. 

For the total sample, the correlation of .57 
between the Bennett Mechanical and the 
Terman-Miles tests indicates that of the test 
variables employed the Bennett is the best 
single predictor of Terman-Miles M-F. In- 
deed, for this group the Bennett test predicts 
masculinity-femininity as well or better than it 


scores 


Table 2 


Product Moment Correlations of the Terman-Miles 
Attitude-Interest Analysis Test with the 
Ability Test Variables 


Test Variables Males Females 


Group 


Terman-Miles M-F and 
Bennett Mech. Compr. 
Terman-Miles M-F and 
Minn. Clerical 
Terman- Miles M-F and 
ACE Psychol. Exam. 


ll 
—.09 


O08 


* Significant at 5% level of confidence. 
** Significant at 1% level of confidence. 


* Scores on the ACE test were available for approximately 80% of the experimental group. 


Females 
(N = 72) 


Total Group 
(N = 174) 


8.6 
46.9 270.5 
40.6 
25.0 


— 26.9 
86.1 


+41.0 3.7 
86.8 Da 


25.8 


N’s for this test 


predicts various mechanical criteria (4, 8, 9, 
12), and correlates about as high with the 
Terman-Miles test as do many M-F tests with 
each other (7). Thus, if a mixed-sex group is 
used as the frame of reference, the Bennett 
may in a sense be referred to as a disguised 
measure of masculinity-femininity. More- 
over, the Bennett predicts Terman-Miles M-F 
as well when used alone as when supplemented 
by the Minnesota Clerical Test. The ob- 
tained multiple R of .58 indicates that little 
predictive efficiency is gained by using both 
tests. 
The Terman-Miles M-F 

Clerical tests correlate —.22 with each other, 
indicating that for the sexes combined, meas- 
ured femininity is positively related to clerical 
proficiency, but that the relationship is not 
nearly as high as that between masculinity and 
mechanical ability. Since the sex overlap of 
the Minnesota score distributions is more than 
twice that of the Bennett distributions, this 
result might well be expected. One of the 
reasons for the difference in correlation magni- 
tude may be that the Bennett is more heavily 
loaded with experiential and informational 
factors than the Minnesota Clerical Test. Not 
only is the sex difference in means comparatively 
smaller for the Minnesota than for the Bennett, 
but the improvement that takes place with 
age in adolescence is also proportionately 
smaller for the Minnesota test: 9% as com- 
pared with a 23% improvement on _ the 
Bennett (1, 2). Both of these findings sug- 
gest that experience affects performarce to a 
greater degree on the mechanical thah on the 
clerical test. If the posited information load- 


M 


and Minnesota 
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ing does exist, then the Bennett test is prob- 
ably in part a measure of interest as well as of 
aptitude. It should therefore be expected to 
correlate more highly with the M-F inventory, 
which also measures interest factors. 

The obtained correlation of .12 between the 
ACE and the Terman-Miles M-F tests indi- 
cates that intelligence and masculinity-femi- 
ninity are at best negligibly correlated in a 
mixed sample. This finding is consistent with 
the general trend of research which has shown 
little or no difference between comparable 
groups of males and females on standard tests 
of intelligence (16). 

It should also be pointed out that although 
the mechanical and clerical tests both correlate 
positively with the ACE test, they correlate 
significantly negatively with each other (—.24). 
This negative correlation is probably due 
mainly to the opposite direction of sex differ- 
ences, for if general ability is partialled out of 
both tests the negative correlation becomes, as 
anticipated, somewhat greater (—.35). How- 
ever, the case of two tests which are related 
positively to general ability and negatively to 
each other is uncommon in the field of psycho- 
metrics, and suggests interesting applications 
of partial correlation and suppression §tech- 
niques. 

Intra-Sex Differences. The discussion thus 
far has been concerned with results obtained 
on a mixed sex sample. The inter-sex differ- 
ences obtained for both the Bennett Mechani- 
cal and the Minnesota Clerical tests are sub- 
stantial, and the Bennett test, in particular, is 
a significant predictor of Terman-Miles M-F 
scores. However, it was realized from the 
start that a more convincing demonstration of 
the predictive efficiency of ability test scores 
for the postulated trait of psychological mas- 
culinity-femininity could be obtained from 
correlations reported for each sex separately. 

While the coefficients presented in Table 2 
indicate that Terman-Miles M-F is not signifi- 
cantly associated with measured mechanical or 
clerical abilities within the male group, the ob- 
tained correlations are in the expected di- 
rections. For women, M-F is correlated to a 
low but statistically significant degree with 
both Bennett and ACE scores, but not with 
Minnesota Clerical scores. These results indi- 
cate that mechanical comprehension tends to 
be a masculine characteristic for women, and 
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corroborate Terman and Miles’ finding that 
brighter college women tend as a group to rank 
slightly more masculine than their less able 
colleagues (14). 

The best prediction of Terman-Miles M-F 
for women is obtained by using both the 
Bennett and ACE tests. Although the ob- 
tained multiple R of .30 is not high enough for 
practical purposes, the data were derived from 
a sample which was very homogeneous with 
regard to age, education, and regional back- 
ground. 

In general, most of the within-sex differ- 
ences are in the same direction as the obtained 
inter-sex differences but are much reduced in 
magnitude. These reductions in correlation 
size are much greater than would be expected 
from attenuation due to restriction of the total 
sample range. Such results suggest either: 
(1) that Bennett Mechanical and Minnesota 
Clerical test scores are not particularly good 
indicators of intra-sex M-F; or (2) that the 
validity of the Terman-Miles test as a meas- 
ure of M-F within each sex should be more 
carefully investigated. 


Summary 


The following major conclusions were de- 
rived from the data obtained in this investi- 
gation: 


1. Men perform significantly better than 
women on the Bennett Test of Mechanical 
Comprehension, Form AA, and women dem- 
onstrate a somewhat less marked superiority 
on the Minnesota Clerical Test. 

2. For a mixed-sex group, the Bennett Me- 
chanical test predicts Terman-Miles M-F as 
well or better than it does most of the me- 
chanical criteria against which it has been 
validated. Moreover, its correlation with the 
Terman-Miles test compares favorably with 
reported ' intercorrelations of 


various tests 


specifically designed to measure masculinity- 
femininity. 

3. Although the Minnesota Clerical 
predicts Terman-Miles M-F for a mixed-sex 
group at a statistically significant level, it does 
not contribute substantially to the Bennett in 
multiple prediction of masculinity-femininity. 


Test 


4. Most of the intra-sex correlations be- 
tween ability test and M-F test scores are 
essentially in the same direction as those ob- 








380 


tained for the total group, but are much re- 
duced in magnitude. These reductions in 
magnitude are in excess of what might be ex- 
pected due to restriction of score range within 
single-sex groups. 

5. The interpretation of the intra-sex cor- 
relations obtained in this study depends in 
part on the validity of the Terman-Miles test 
as a measure of psychological masculinity- 
femininity. It has been repeatedly demon- 
strated that the test is an extremely efficient 
discriminator of biological maleness-female- 
ness (14). In addition, Terman and Miles 
cite case histories of homosexuals who ob- 
tained scores characteristic of the opposite sex 
on the M-F scale (as well as high scores on the 
inversion scales). However, there is no con- 
clusive evidence that the test is measuring 
intra-sex M-F with a high degree of validity 
within the normal range of the population. 
In order to develop such a test it would be 
neccssary to employ the additional criterion 
of ratings of psychological M-F using a suffi- 
cient number of competent judges to insure 
adequate reliability. Terman and Miles used 
only a few judges and were discouraged by the 
low reliabilities which they obtained. How- 
ever, by increasing the number of raters to 30 


or 40 through the use of sorority or fraternity 
groups, it should not be too difficult to achieve 
satisfactory reliabilities, as can be readily es- 
timated by application of the Spearman- 
Brown formula. 

6. One of the original purposes of this proj- 
ect was to explore the feasibility of developing 


a disguised measure of masculinity-femi- 
ninity from ability-type tests. As Terman and 
Miles (14) have pointed out, their M-F test is 
easily fakable if subjects are motivated to this 
end, even though the purpose of the test is 
otherwise difficult to discern. A non-fakable 
M-F test would be desirable, especially in 
selection situations, and if the test were of the 
ability type it would have the added virtue of 
providing both personality and ability scores 
for the same expenditure of time. Since it 
has a fairly high correlation with the Terman- 
Miles test within mixed-sex groups, and since 
it is so successful in differentiating the sexes, 
the Bennett Test of Mechanical Compre- 
hension could conceivably serve as the basis 
for developing such a test. It could be con- 
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structed by analyzing a large pool of items 
similar to those found in the original Bennett 
and selecting those which most successfully 
differentiate men from women and at the samé 
time serve as predictors of mechanical ability. 
As an additional criterion for item selection, 
trait ratings as proposed above should be used 
in order to insure high intra-sex differenti- 
ation. 


Received January 10, 1952. 


References 


1. Andrew, Dorothy M., and Paterson, D. G. Man- 
ual for the Minnesota Clerical Test. (Rev. Ed.) 
New York: Psy. Corp., 1946. 

. Bennett, G. K. Manual for the Test of Mechanical 
Comprehension, Form AA. New York: Psy. 
Corp., 1940. 

. Bennett, G. K., and Cruikshank, R. M. Sex 
differences in the understanding of mechanical 
problems. J. appl. Psychol., 1942, 26, 121-127. 

Bennett, G. K., and Fear, R. A. Mechanical com- 
prehension and dexterity. Personnel J., 1943, 
22, 12-17. 

. Englehardt, Olga E. The Minnesota Clerical Test: 
sex differences and norms for college groups. 
J. appl. Psychol., 1950, 34, 412-414. 

. Goodenough, Florence L. The consistency of sex 
differences in mental traits of various ages. 
Psychol. Rev., 1927, 34, 440-462. 

. Heston, J. C. A comparison of four masculinity- 
femininity scales. Educ. psychol. Measmt., 1948, 
8, 375-387. 

. McDaniel, J. W., and Reynolds, W. A. A study 
of the use of mechanical aptitude tests for selec- 
tion of trainees for mechanical occupations. 
Educ. psychol. Measmt., 1944, 4, 191-197. 

. Moore, B. V. Analysis of tests administered to 
men in engineering defense training courses. J 
appl. Psychol., 1941, 25, 619-635. 

. Paterson, D. G., Elliott, R. M., Anderson, L. D., 
Toops, H. A., and Heidbreder, E. Minnesota 
mechanical ability tests. Minneapolis: Univ. of 
Minn. Press, 1930. 

. Schneidler, Gertrude G., and Paterson, D. G. Sex 
differences in clerical aptitude. J. educ. Psy- 
chol., 1942, 33, 303-309. 

. Shuman, J. T. Value of aptitude tests for factory 
workers in the aircraft engine and propeller 
industries. J. appl. Psychol., 1945, 29, 156-160. 

. Stenquist, J. L. Measurements of mechanical abil- 
ity. New York: Teachers College Contributions 
to Education, No. 130, 1923. 

. Terman, L. M., and Miles, Catherine C. Sex and 
personality. New York: McGraw-Hill, 1936. 

. Thurstone, L. L., Thurstone, Thelma G., and 
Adkins, Dorothy C. The 1938 Psychologica! 
Examination. Educ. Rec., 1939, 20, 263-300. 

6. Tyler, Leona E. The psychology of human differ- 
ences. New York: Appleton, 1947. 





Ability Patterns in Technical Training Criteria ' 


Benjamin Fruchter 
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A number of different systems for classi- 
fying occupations into job families have been 
proposed (3, 10, 12, 13). Several investi- 
gators (1, 8) have applied factor analysis 
methods to the problem. The classifications 
have been based largely on the common ele- 
ments such as skills, intelligence, and per- 
sonality traits needed for successful perform- 
ance in the occupations. 

The present approach attempts to classify 
occupations on the basis of the profile of apti- 
tudes required of the persons who are candi- 
dates for training. It should be particularly 
applicable to vocational and _ educational 
guidance and in the Armed Services, where a 
period of training usually precedes assignment 
to an occupation. Occupations which are 
quite different at the level of skilled perform- 
ance may require similar profiles of aptitudes 
of applicants for training. Thus, it might be 
found that candidates for training as weather 
observers and clerk-typists require similar 
aptitudes although the jobs themselves are 
quite different above the training level. 

Both Guilford (5) and Gulliksen (7) have 
stressed the importance of analyzing criteria 
from the factorial approach so that the rela- 
tive contribution of various aptitudes and 
traits to successful performance might be 
evaluated. Scores on a battery of selection 
or classification tests can then be related to 
ultimate performance in one or more occupa- 
tions, and appropriate assignment can be 
made. 


Population and Factor Analysis 


The present exploratory study was done 
with data from the USAF Air Training Com- 
mand. A battery of classification tests is 


' Based on a paper read at the American Psycho- 
logical Association meetings in September, 1950. Al- 
though this study was done while the writer was a 
civilian employee of the Air Training Command, the 
views expressed in this article are those of the writer 
and do not necessarily represent the official views of the 
United States Air Force. The writer wishes gratefully 
to acknowledge considerable computational assistance 
from Mr. William L. Grafton. 


routinely administered to airmen, and the 
results are used to assign them to technical 
schools for training in various occupational 
specialties. To evaluate the effectiveness of 
the tests in selecting successful candidates for 
training, the scores are validated against the 
final grades made in the technical schools. 

The following two alternative approaches 
suggest themselves for determining the factor 
content of these final-grade criteria: 


1. Consider each technical specialty a sepa- 
rate populction and perform a factor analysis 
of the intercorrelations of its criterion and the 
test battery, or, 

2. Consider the airmen a single population, 
perform a factor analysis of the batiery on a 


representative sample. Estimate the factor 


content of each training criterion on the basis 
of the factor loadings obtained from the com- 
bined population and the validity of the tests. 


The latter approach was adopted because 
the loadings from specialty to specialty would 
be more comparable and a prohibitive number 
of factor analyses would not be required. 

A representative sample of 389 airmen who 
had been assigned to training in technical 
schools was drawn. Each school was repre- 
sented in the sample in proportion to the 
total number of airmen who had been sent 
into that type of training, and the individuals 
chosen to represent each school were randomly 
selected. 

The students were all male, mostly 18 and 
19 years old, and had on the average a tenth- 
grade education. The intercorrelations of 
the 19 tests administered to them were ob- 
tained from the Quarterly Research Reports 
of the USAF Air Training Command, 3309th 
Research and Development Squadron (II, 
p. 5). Six factors were extracted by the 
centroid method and rotated to psychologically 
meaningful positions. Table 1 gives the ro- 
tated loadings for the 19 variables. The 
orthogonal rotated factors are identified as 
follows: I. Numerical facility (N); I]. Verbal 
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Table 1 


Rotated Factor Loadings for Stratified Sample of Technical School Students 
Sample: 389 airmen assigned to technical schools 


(Decimal points omitted throughout) 


Test Variables* 


. Reading Vocabulary 
Arithmetic Computations 
Arithmétic Reasoning 

. Pattern Analysis 

. Mechanical Aptitude—2 

. Biographical Inventory No. 1 

. Memory for Landmarks 

. Background for Current Affairs 
Biographical Inventory No. 2 
Arithmetic Reasoning 

11. Aviation Information 
12. 
13. 
14. Electrical Information 
15. Mechanical Principles 

. Numerical Operations No. 1 
17. Numerical Operations No. 2 
18. 
19. 


Dial and Table Reading 

Reading Comprehension 

06 
02 
70 
78 
Ol 
O8 
N 


General Mechanics 
Speed of Identification 


Factor 


IV 


14 
04 
00 
33 
77 


Zi 


1< 


! 


Nm NM Ww bh 
wr rm Ww 


16 
—O05 
32 
13 
16 
31 
08 
25 
23 
19 
47 
—18 
03 
14 
16 
Vz 


39 


?? 


38 

28 
59 
38 
O8 
O08 
00 63 
54 26 
P ME 


18 
38 
36 
28 71 
60 
43 


* Variables 1 through 4 are part scores of the AGCT. Variable 5 is also an AG test. Variables 6 through 19 


are the Airman Classification Test Battery. A description of these tests is contained in Dailey (2, Appendix A). 


comprehension (V); III. Socioeconomic back- 
ground (SE); IV. Perceptual speed (P); V. 
Mechanical experience (ME); and VI. Visual- 
ization (Vz). 


Factor Loadings of Criteria 


The validity coefficients of the 19 tests were 
available for 14 technical-school final-grade 
criteria. They were obtained from Dailey (2). 
Table 2 lists the criteria, N for each, and the 
means and standard deviations for the groups 
on certain representative tests (a relatively 
pure test.of each of the six factors isolated). 
The standard deviations were examined in 
order to obtain an estimate of the relative 
variabilities of the groups on each factor. The 
factor content of the training criteria was 
estimated by Mosier’s (9) extension of Dwyer’s 
(4) method for obtaining the factor content 
of a variable not included in the original analy- 


sis. Table 3 gives the factor loadings and 
communalities of the criteria.” 

The airmen were sent to the technical- 
training schools on the basis of their perform- 
ance on the tests in the battery, and there is 
consequently considerable restriction of range 
in the tests, as well as on related tests for the 
selected groups. This restriction tends to 
reduce the validity coefficients and conse- 
quently the size of the factor loadings as 
compared with unselected groups. 
mate the size of the loadings for unrestricted 
samples, the values in Table 4 were calcu- 
lated. The scores on the Airman Classifica- 
tion Battery are scaled to yield a standard 
deviation of 2.0 for unrestricted samples, and 


To esti- 


2 To reduce printing costs Tables 2 and 3 have been 
deposited with the American Documentation Institute. 
Order Document 3599 from American Document Insti- 
tute, 1719 N Street, N.W., Washington 6, D. C., 
remitting $1.00 for microfilm (images 1 inch high on 
standard 35 mm. motion picture film) or $1.00 for 
photocopies (6X8 inches) readable without optical aid. 
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the A. G. tests are scaled to yield a standard 
deviation of 20.0 for similar groups. Using 
the standard deviations on the tests in Table 2 
as estimates of the amount of restriction of 
each criterion group on the factors, the load- 
ings for an unrestricted sample were estimated 
by the formula for correction for restriction- 
in-range, case 1 (6, p. 349), and are shown in 
Table 4. The loading of a criterion on a 
factor was considered the correlation between 
the criterion and the factor. An alternative 
and possibly more defensible procedure would 
have been to apply the corrections directly to 
the validity correlation coefficients. 

It will be observed that the criteria have 
a.considerable range of communalities. The 
very low communalities (e.g., for carpenter, 
radio operator ACS, and engineman-operator) 
are probably due largely to the unreliability 
of these criteria, although no direct evidence 
is available on this point. It would be de- 

31f the reliabilities should prove to be satisfactorily 
high then, of course, the indication would be that there 
is considerable specific variance in the criteria and that 
they are not sufficiently covered by the factors in the 
battery. 
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sirable to investigate the reliability of the 
grading systems used in these schools. 

It should be kept in mind when evaluating 
the loadings that the criteria are grades in a 
course of study rather than performance on 
the job. The two highest loadings for air- 
plane and engine mechanic (conventional) are 
on the mechanical-experience and visualization 
factors; for the jet mechanic on the mechanical- 
experience and verbal factors. The curricu- 
lum of the latter school might be examined 
to determine whether the on verbal 
material is necessary or even desirable. 


stress 


The aircraft sheet-metal worker grades are 
loaded highest on visualization with a smaller 
loading on mechanical experience, whereas 
draftsman grades have their highest loading 
on mechanical experience with a somewhat 
lower loading on visualization. These loadings 
might also serve as a basis for evaluating these 
two curricula, as more visualization variance 
might well be expected in drafting grades and 
more mechanical-experience variance in grades 
The high numerical 
loading for the clerk-typist criterion is also 


in a sheet-metal course. 


Table 4 


Estimated Factor Content of Technical Specialty Training Criteria Corrected for Restricted Variability 


Sample: Graduates of the Technical Specialty Schools 
(Decimal points omitted throughout) 


Criterion Group 


Weather Observer 

Radio Operator, ACS 

Radio Operator, General 

A & E Mechanic (Conventional) 
Aircraft Sheet-metal Worker 

A & E Mechanic (Jet) 


Carpenter 


Control Tower Operator 

Draftsman 

Electrician 57 

Engineman Operator 

Clerk-Typist 71 

Medical Corpsman 

Radar Mechanic, General 48 
N 


Factor 


Ill IV 

2 29 32 

2: 24 02 

16 26 26 

04 15 74 44 
01 39 53 

21 06 58 31 
13 18 21 

17 06 20 23 
16 54 32 

17 —03 36 09 

12 06 43 16 

06 —Ol 17 

05 ; -07 15 

01 ; 49 30 

SE ME Vz 


* The sizes of the validation samples of the tests listed in Table 1 varied for each of the criterion groups within 


the limits shown. 
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somewhat surpsing. A 
verbal loading was expected. 


relatively higher 


Discussion and Summary 
The, present study is intended to be ex- 
ploratory and point out the possibilities in 
analyzing criteria as a method for better 
understanding the variance in_ technical- 


training course grades and other proficiency 
The steps in an ideal setup would 


criteria. 
be to: 

1. Administer a comprehensive classifica- 
tion test battery to a large and representative 
sample. 

2. Randomly assign members of the sample 
to courses of training so that the group taking 
each type of training would have an unre- 
stricted range of talent. 

3. Validate each test against a criterion of 
proficiency in the course of training. The 
establishment of reliable and valid criteria is in 
itself an important step. 

4. Intercorrelate and 
test battery. 

5. Estimate 
criteria. 

If desired, further steps might be to esti- 
mate the correlations among the criteria* and 
analyze the resulting correlations into clusters 
to form families of jobs requiring similar kinds 
and amounts of abilities. 

With a comprehensive test battery and 


factor-analyze the 


the factor loadings of the 


* By means of the formula for reproducing the corre 
lation between two variables from their orthogonal 
factor loadings, r12=@1d2-+-B,b2 + --+ + mine. Usu 
ally it is not possible to obtain the correlations between 
criteria directly, since a given group is rarely subjected 
to more than one course of training. 
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validities for large numbers of curricular and 
occupational criteria, it should be possible to 
put vocational guidance and occupational 
classification on a more objective basis. 


Received November 29, 1951. 
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A Psychological Study of Occupational Adjustment * 
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This paper reports a study of male unskilled 
factory workers. The aim may be stated as 
follows: by means mainly of objective psycho- 
logical tests to study the relationships which 
may thereby be shown to exist between various 
aspects of the personalities of a group of un- 
skilled male factory workers, and the extent 
to which they appear to be meeting the 
demands of the job situation. 


Population Studied 


The population consisted of an intact section 
of a basic production department in a medium- 
sized factory. The 80 men concerned, vary- 
ing in age from 22 to 64 years, were unskilled 
operatives on individual piecework who had 
been in that department for periods ranging 
from 1 to 30 years, the median falling at 10 
years. As raw material accounted for nearly 
90 per cent of the cost of the product, the firm 
offered attractive wage and bonus rates. The 
job is one which over the years would select 
men who were in the main physically fit steady 
workers unlikely to be exceptional in many 
respects. It is the kind of job in which 
Russell Fraser (2) found the lowest incidence 
of neurosis. 

Study of the task—pouring molten lead into 
hand-operated moulds—suggests that only 
minimal intellectual equipment would be re- 
quired, and that some obsessionals might 
adapt well. Beyond that it was not 
meaningful to hypothesize in terms related to 
the demands of the job, except insofar as it 
is generally believed that emotional insta- 
bility is reflected in poor job adjustment. 


Personality Variables 


A battery of 22 individually administered 
objective tests was used, designed to cover 


* The author is a member of the Unit for Research 
in Occupational Adaptation, which is based in the 
Maudsley Hospital, Denmark Hill, London, S.E. 5. 
This paper was presented in condensed form to the 10th 
International Congress of Psychotechnics at Gothen- 
burg, Sweden, in July 1951. It is a revision of part 
of a Ph.D. thesis accepted by the University of London 
in 1951. 


such aspects of personality as general mental 
ability, emotional stability, temperament, and 
dexterity. Full details of the tests, the re- 
sults obtained and the methods of statistical 
analysis will be found elsewhere (3). For 
the present purpose it will suffice to say that, 
with age partialled out, the matrix of product 
moment correlations between the tests was 
factor-analyzed, using Burt’s simple sum- 
mation method. The analysis yielded four 
significant factors accounting for 30 per cent 
of the variance. After five orthogonal rota- 
tions, three of these factors were ~eadily 
identified in the light of previous data about 
the tests concerned. 

Factor scores were obtained by simple ad- 
dition of the individual’s normalized per- 
centile scores on the four tests having the 
highest loadings on the factor in question, in 
the final rotated solution. In this way ne 
weight has been given to the actual loadings 
themselves. The factor analysis has in effect 
been used to select small groups of tests which 
have been shown to be related to one another 
in a psychologically meaningful way. Its 
arithmetic is then abandoned, and relation- 
ships between the ‘factor scores” and the 
criteria are expressed as zero-order coeffi- 
cients. 


Criteria of Occupational Adjustment 


Details of the establishment of these criteria 
will be found elsewhere (4). In view of their 
decisive importance, however, a description of 
each is considered necessary here. 

Productivity. This was an index based on 
the individual’s average productivity over a 
period of 67 weeks, as obtained from shop-floor 
records. It appeared to be so closely related 
to actual output (checked for 45 men over 26 
weeks on a particular type of casting) as to 
justify considerable confidence in its use. The 
principal criticism to which it should be sub- 
jected is that it may suffer from artificial 
limitation of range due to external variables. 
It is free from the familiar criticism in terms of 
the unknown effect upon production which 
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can result from direct observation of the 
workér’dr the installation of special counting 
devices. As these men were working on an 
individual piecework basis, such an index 
seems to provide a measure of occupational 
effectiveness in terms of the individual’s 
“ability” to earn his living relative to that of 
others doing the same work. This does not, 
however, take into account the incentive 
differences arising from social, familial and 
economic pressures. Two men might easily 
the same hypothetical ability to 
carry out the working-operation at a high 
average rate, but one might show an actual 
rate much lower than the other because, for 
example, his wife was earning and he had no 
children to support. All but one of the men 
in the present study were married and a con- 
siderable proportion had children under school- 
leaving age. The latter variable was found 
to correlate with Productivity +.226 (P=.05), 
thus illustrating the point under discussion. 
It seems obvious that no collection of psycho- 
logical assessments could hope to account 
among them for more than a small propor- 
tion of the variance of this criterion. 

Job Adjustment. For this the author ob- 
tained a rating on a normally distributed 5- 


possess 


point scale, combined from the independent 
ratings of six supervisors on each of two oc- 


casions five weeks apart. The average con- 
sistency coefficient of the raters was .78, and 
careful statistical analysis established the 
unidimensionality of the criterion. It may be 
defined as a measure of the extent lo which a man 
is a source of concern to his supervisors. 

This criterion differs from a ‘‘merit rating” 
as generally used. The latter is most usually 
a means whereby men are considered for pro- 
motion in status, responsibility or earnings, 
and the rater’s judgments are deliberately 
oriented in such a way as to maximize the 
predictive power of the rating for these pur- 
poses. In the present situation, no such 
merit rating system was in existence; the 
procedure used was to obtain an assessment 
of the extent to which each man was a source 
of concern to the supervisor. Further, the 
role of the investigator as a member of a re- 
search unit was already well established, and 
his independence of management recognized 
to a very considerable extent. The influence 
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of “halo” resulting from familiarity was not, 
however, wholly absent; this could not readily 
be avoided when studying a well-established 
group whose experience in that department 
ranged from 1 to 30 years. In general, the 
criterion may perhaps be regarded with some 
justification as being satisfactory for the 
purpose. 


Results 


In view of the significant correlation with 
age of various tests in each factor score, its 
effects have been held constant by partial cor- 
relation when computing the relationship of 
each factor score with the Productivity 
criterion. When the Job Adjustment criterion 
is involved, both age and experience in the shop 
are held constant, as the latter variable cor- 
relates +-.4 with this criterion. 

For the sake of clarity the results are pre- 
sented in summary form, and only those co- 
efficients are shown which are significant at 
the .05 level or better. Short titles of tests 
are provided in order to facilitate reference to 
details available elsewhere (3). 

1. Factor I. “General Mental Ability” 
(Dominoes Non-verbal + Letter Series + 
Paper Formboard + Vocabulary) showed no 
significant relationship with either criterion. 

2. Factor II. This factor is not named, but 
is suggestive of ‘Hysteric Tendency” or 
“Neurotic Extraversion” (low Hand Persist- 
ence + low Leg Persistence -+ many Food 
Aversions + high “‘neurotic” score on Word 
Connection List) and also showed no signifi- 
cant relationship with either criterion. 

3. Factor III. “Emotional Instability” 
(many Worries -++ much Static Ataxia + many 
Annoyances + many Interests) correlated with 
Poor Job Adjustment +.45 (P = .001). 

4. Factor IV. “Speed of Approach” 
(Finger Dexterity + Quick Approach to Time 
Test + Manual Dexterity + Speed on Track 
Tracer) showed the following relationships: 
(a) with Productivity, +.25 (P = .05); and 
(b) with Good Job Adjustment, +.28 (P = 
01). 

5. An unweighted combination of Factor III 
(reversed) and Factor IV, using the “‘pooling 
square” technique, gave a correlation with 
Good Job Adjustment of +.53. 
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Discussion 

It may be concluded formally that the null 
hypothesis was confirmed in respect of general 
mental ability, as assessed by non-verbal, 
verbal-educational and visuo-spatial _ tests. 
In view of the low level of intellectual demand 
implicit in the actual job, and the number of 
men employed on it who were shown to be 
well above average in general mental ability, 
this finding is of some importance. If it were 
true in this instance, as suggested by Wyatt 
and Langdon (6), that such men would be 
handicapped by their excess of unneeded intel- 
lectual potential, this should have been re- 
flected in a small negative relationship with 
one or more criteria of adjustment; no such re- 
lationships were found. It may be, of course, 
that these mer exhibit adaptation to other as- 
pects of the total situation which favor them 
in a way which they had not encountered on 
jobs apparently more in line with their in- 
tellectual potentialities. Conversely, it also 
seems of some importance that men of ex- 
tremely low mental ability—equivalent - in 
several cases to that of high-grade mental 
defectives—appear able to do this job satis- 
factorily. This supports the conclusion reached 


by Tizard and O’Connor (5), when considering 
the employability of high-grade menta! de- 


fectives, that monotonous work of a rela- 
tively simple kind may suit them well. 

If the hypothesis be advanced that ‘‘emo- 
tional instability” as evidenced by objective 
tests is related systematically to “poor job 
adjustment” as rated by supervisors, it is sus- 
tained by the findings. It is not sustained in 
respect of productivity. The four tests having 
the highest loading on this factor are all as 
sociated with what has been described as the 
“dysthymic” rather than the “hysteric” end of 
the temperament continuum in neurotics. (1). 
This includes the anxiety states, obsessional 
tendency and reactive depression. It seems 
that in the sample studied it is this heterogene- 
ous group of relatively unstable men who tend 
to be a source of concern to their supervisors. 
Their handicap is not, however, sufficient to 
affect their productive capacity over a long 
period. 

No hypothesis is required to provide a basis 
for the unsurprising finding that a tendency to 
“Speed of Approach to a Task,” as measured 
by the Factor IV score, is related to Produc- 
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tivity. If, as has been suggested, this may be 
regarded as a characteristic mode of person- 
ality, then for a man engaged on individual 
piecework its deficiency appears to constitute 
a handicap. At this point we may recollect 
the attenuating effects on such a relationship 
of the defects of the criterion; it may well be 
that a coefficient of .25 represents in this in- 
stance a more serious handicap than would ap- 
pear from its size. 

The combination of a high tendency to 
“emotional instability” of an anxious or de- 
pressive type, and a slow characteristic ap- 
proach to a task, is found to be related to 
supervisory assessment of job adjustment at a 
level which, without the aid of weights de- 
rived from multiple correlation, is high 
enough (.53) to be regarded as evidencing a 
genuine handicap in the situation studied. 


Summary 

1. This paper reports~ the 
found between personality variables and 
occupational adjustment in a sample of 80 
male unskilled factory workers. 

2. Personality variables were derived from a 
factor analysis of the intercorrelations between 
22 individually-administered objective tests. 

3. Two occupational criteria were specially 
prepared for the investigation; one was a meas- 
ure of productivity, the other of the extent to 
which-men were a source of concern to their 
supervisors. 

4. Some significant relationships were found 
and are discussed briefly from various points 
of view. 


relationships 
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How Supervise? Scores Before and After Courses in Psychology 


Frederic R. Wickert 


Michigan State College 


How Supervise? is a device developed by 
File and Remmers for the measurement of 
attitudes and understandings necessary for 
supervisory success. Karn (2), in summa- 
rizing the rather inconclusive evidence for the 
validity of this questionnaire, states, “‘. 
Further studies appear to be in order before 
the question concerning the universal validity 
of the test can be settled.” 

Karn then reported an investigation of his 
own which he felt had a bearing on the validity 
of How Supervise?. He administered Forms 
A plus B of this test to 108 college students in 
their junior year, before and after a course in 
psychology. He also administered the two 
forms of this test to a comparable control 
group of 104 students before and after a course 
in English literature. Results showed that 
the two groups achieved the same mean 
scores on the test at the start of the psychology 
and English courses, respectively. When the 
test was readministered at the end of each 
course, however, the psychology (experimental) 
group had gained significantly, but the English 
(control) group had not. Karn further re- 
ports that Form B alone (as well as Forms A 
plus B) was sufficiently sensitive to show a 
significant difference for the psychology (ex- 
perimental) group on initial and final testings. 

The present study was designed, from one 
point of view, to supplement the Karn study 
by providing further evidence on the validity 
of How Supervise?. From another point of 
view, if one assumes that How Supervise? 
measures the attitudes and understandings 
that enter into good human relations, the 
present study was concerned with discovering 
the degree to which such attitudes and under- 
standings had been taught in various types of 
psychology courses at the college level. From 
the first point of view, then, the present study 
was a test validation project; from the second 
point of view it was an educational research 
project. The reader may take his choice. 
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Procedure 


Four groups of students at Michigan State 
College served as subjects.'. Group 1 was 
made up of 68 students in the begining course 
in general psychology. The majority of 
these students were sophomores with a 
sprinkling of freshmen as well as a few juniors 
and seniors. They came from many depart- 
ments of the College. The content of this 
one-quarter course was that traditionally 
covered in such courses: perception, emotion, 
learning, motivation, etc. No attempt was 
made to discuss psychological factors in human 
relations problems. 

The 77 students in Group were 
primarily sophomores. No freshmen were in- 
cluded, but there was a somewhat larger pro- 
portion of juniors and seniors than in the 
general psychology course. This second 
course was the beginning course in industrial 
psychology, and, as might have been expected, 
about half the students came from the School 
of Business and Public Service and the other 
half from the School of Science and Arts. The 
course in general psychology was a prerequisite 
for this course, so it represents the second 
stage in a hierarchy of courses. About one- 
fifth of the course was directly devoted to 
teaching the psychology of human relations 
in industry; the remainder of the course was 
concerned with such traditional topics in 
industrial psychology selection testing, 
merit rating, training, job analysis and job 
evaluation. 

The 51 students in 


) 


also 


as 


Group 3 were about 
evenly divided between juniors and seniors. 
They were taking a course completely devoted 
to the study of psychological factors in human 
relations in industry. The prerequisite for 
this course was the beginning course in indus- 
Hence it the third 
course in the hierarchy. 


trial psychology. was 


! Group 1 was 41% women, Group 2, 17%, Group 3, 
15%, and Group 4, 29%. 
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For Group 4, 31 students taking either or 
both of two advanced courses in industrial 
psychology were used. These students were 
all seniors. These two courses, which had 
the course in the psychology of human rela- 
tions in industry as one of their prerequisites, 
were concerned with: (1) how to do various 
kinds of interviewing in industry and govern- 
ment situations; and (2) training and super- 
vising in industry and government. The 
courses depended on and referred to psycho- 
logical factors in human relations but did not 
specifically emphasize them or elaborate upon 
them. 

These four groups, then, represented each of 
four stages of a hierarchy of successively more 
advanced courses in psychology, the first of 
which had little or no human relations train- 
ing content, the second with some, the third 
almost completely, and the fourth relatively 
little except as an assumed foundation. The 
problem of this study was to work out the re- 
lationship between training in human rela- 
tions and performance on How Supervise?. 
Fortunately, Karn, in the study already 
referred to, had demonstrated that a control 
group, under circumstances roughly compa- 
rable to those of the present study, showed no 
appreciable gain between initial and terminal 
testing on How Supervise?. Accordingly, no 
series of control groups matched with each of 
the four experimental groups were utilized in 
the present study. It was assumed, perhaps 
not with complete justification, that such 
control groups would have shown no gains 
just as Karn’s control group did not. 

The details of administration of the test are 
as follows. In each of the four groups during 
the first week of the same college quarter, 
Form A was given to one half the group and 
Form B to the other half. During the last 
week of the quarter, Form B was given to 
those who were initially tested on Form A, 
and Form A was given to those initially tested 
on Form B. of forms was 
A and B are 


This reversing 


done since File said, ‘Forms 
closely equivalent.” He 
Norms of ‘One Form Only’ may be applied to 
either Form A or Form Bb.” Furthermore 
he suggested using the different forms if ‘‘re- 


peated testing is anticipated” (1). 


also added, 


Results 


Since Form A was given first to half of each 
group and was followed by Form B, and the 
opposite procedure was followed for the other 
half of each group, it was possible to check 
the comparability of the two forms in detect- 
ing the effects of training. Table 1 shows this 
comparison. It will be seen that the means 
of both Forms A and B, when given first, were 
practically identical. It will also be seen 
that when Form A was followed by Form B, 
a significant gain occurred. However, when 
Form B was followed by Form A, some gain, 
but not a statistically significant one, re- 
sulted. This finding suggested that the two 
forms, though identical on first administration, 
were not equally sensitive to picking up the 
effects of the kind of human relations training 
involved in this study. Notwithstanding this 
finding, it was decided to include in the analysis 
of results all the cases, that is, to include those 
who took Form B first followed by Form A as 
well as those who took Form A first followed 
by Form B 

The principal results are shown in Table 2. 
This table compares initial and terminal scores 
on How Supervise? for each of four successively 
more highly trained groups. The table indi- 
cates that there was some gain in all four 
groups. Group 3, which received the most 


Table 1 


Comparison between Forms A and B of How Supervise? 
When Used in Initial and Terminal Testing, 
All Four Groups Combined 


Form A Given 
First and 
Form B Second 


Form B Given 
First and 
Form A Second 

N 114 113 

Mean of form 

48.07 (Form A) 
9.62 


given first 
S.D. 
Mean of form 


48.11 (Form B) 
8.88 


49.16 (Form A) 
58 7.90 


given second 53.00 (Form B 
S.D. 7 
Difference be 


tween means 4.93 (Gain) 
as ad 4.98* 


1.05 (Gain) 
1.01 

* Significant at 1% level. (A “t” of 2.6 is needed 
for significance at 1% level and 1.99 at 5% level.) 
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Table 2 


Comparison of Initial and Terminal Scores on How Supervise? for Four Successively 
More Highly Trained Groups 


Group 


>General Psychology 


After 


3 
4 Sophomore Industrial Psychology 


After 


Psychology of Human Relations 
in Industry 


After 


x pouaine Industrial Psychology After 
* Significant at 5% level. 
** Significant at 1% level 


direct training in human relations principles, 
showed the greatest gain (significant at the 
1% level). Group 2, which received some 
human relations training, showed the next 
greatest gain (significant at the 5% level). 
Group 4, which received additional human 
relations training indirectly only, showed con- 
siderable gain but the N was too small to show 
statistical significance. Group 1, the training 
for which included only occasional and then 
only superficial references to human relations 
principles, showed the least gain (not statis- 
tically significant).” 

The results in Table 2 also suggest the 
operation of certain factors other than train- 
ing in human relations. At the time this 
project was carried out, there were, during 
each of the 3 quarters of the regular academic 
year, about 20-22 sections of general psy- 
chology of about 80 students each, 5-6 sec- 
tions of sophomore industrial psychology of 

* An explanation of the appreciable gain in the test 
scores of Karn’s general psychology group before and 
after training and the negligible gain of the general 
psychology group at Michigan State College deserves 
to be mentioned. Karn states regarding the Carnegie 
Institute of Technology course, ‘‘the emphasis . was 

. upon the application of psychological principles to 
adjustment problems, particularly those likely to be 
encountered in human relations situations in industry,” 
while the content of the course at Michigan State 
College, as was mentioned earlier in this paper, was 
more orthodox. 


Before 
Before 
Befc re 


~ Before 


Before vs. After vs. 
After Next Before 
a ad 66999 


1.01 (gain) 


2.44* (gain 


1.81 (gain) 


about 80 students each, and 2 sections of the 
psychology of human relations in industry of 
from 25 to 30 students each.* Two of the 
three quarters, there were generally 2 different 
classes in senior industrial psychology of 20 
students each. This means that only perhaps 
a fourth of the students in general psychology 
went on to sophomore industrial psychology. 
For many students, these two courses were 
required. Group 3, however, was more highly 
self-selected; the course in the psychology of 
human relations was not required so that 
it was usually limited to highly interested 
students. Generally, students took the 
courses represented by Groups 1, 2, and 3 
closely following one another in time. There 
was usually a considerable lapse of time, often 
3 to 5 quarters, before taking senior indus- 
trial psychology. 

With the above administrative factors in 
mind, it is not difficult to interpret certain of 
the results in Table 2. Students in sophomore 
industrial psychology entered that course at 
just about the level of training in human re- 
lations they had attained in their general psy- 
chology course. They did not appear to be 

$It should be pointed out that the one section of 
general psychology and one section of sophomore indus- 
trial psychology were assumed to be representative ol 


the total group. Groups 3 and 4, however, included 
all the students in the courses covered in this study. 
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very much different in their knowledge of 
human relations principles from the mass of 
students finishing the one beginning course in 
general psychology. The relatively small 
group of students who went on to the psy- 
chology of human relations in industry, how- 
ever, started significantly above the mean (as 
shown by the entry in the column headed 
“after vs. next before ‘t’”). The fact that 
the still smaller group (Group 4) in the senior 
industrial psychology courses started and 
ended at about the same level as Group 3 is 
not easy to interpret. It is possible that 
generally the poorer students from the psy- 
chology of human relations classes went on 
into the senior industrial psychology. It is 
also possible. that these seniors might have 
forgotten some information in the 3 to 5- 
quarter time gap between their having taken 
the psychology of human relations course and 
the senior industrial psychology course. A 
further possibility is that these students were 
scoring so close to the upper possible scores 
(about the 95th percentile on Files’ “lower 
level supervisor” norms and about the 70th 
percentile on the “higher level supervisor”’ 
norms) that it was difficult for a group aver- 
age to stay consistently high. 


Discussion 


The results of this study showed first that 
the two forms of the File-Remmers question- 
naire might well be equivalent before a specific 
course of training in human relations principles 
but were not equivalent in their sensitivity to 
changes brought about by such a course of 
training. One form (Form B) proved to be 
quite sensitive but the other form (Form A) 
was not. Some further analyses of the kinds 
of items in the two forms, of the content of 
the training courses, and of the data in this 
project (not reported here) failed to disclose 
any very good reasons for this finding. 

Notwithstanding the differential sensitivity 
of the two forms, the File-Remmers test was 
found to have considerable validity in the 
sense that gains in the scores before and after 
a course of training corresponded closely to 
the known content of the training courses. 
The greater the human relations content, the 
greater was the gain. 
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If on the other hand the File-Remmers test 
is assumed to have validity, it could then be 
stated that the training was having a signif- 
icant effect in inculcating the attitudes and 
understandings underlying good human re- 
lations. 

This study, then, supplements that of Karn. 
In general, it shows successive gains in knowl- 
edge of human relations principles through a 
series of successively more advanced courses in 
psychology. It also, to use Karn’s words, is 
“a contribution towards the establishment of 
the universal validity of the test since it 
deals with cojlege students under aca- 
demic instruction. Previous studies, which 
have shown positive gains with training, have 
been concerned with the effects of specific 
industrial training programs among on-the-job 
supervisory personnel. The demonstration 


of improved scores under a variety of training 
conditions indicates that the responses are a 
result of the application of basic principles to 
the problems rather then the acquisition of 
specific answers to the questionnaire items.’ 


Summary 


Four groups of college students, each group 
at a successively more advanced level of train- 
ing with respect to knowledge of human rela- 
tions principles, were given the File-Remmers 
test, How Supervise?, before and after each of 
four successively more advanced courses in 
psychology. Control groups were not used 
since an earlier study by Karn, under roughly 
comparable circumstances, had already shown 
that while an experimental group of college 
students gained in knowledge of human re- 
lations principles, a control group did not gain 
appreciably. It was then assumed, perhaps 
not with complete justification, that if control 
groups matched for each experimental group 
in the present study had been utilized, they 
would not have shown the gains made by the 
experimental groups. 

Results showed that the two forms of the 
test were closely equivalent before training, 
but Form A following Form B was consider- 
ably less sensitive in detecting the effects of 
human relations training than Form B follow- 
ing Form A. 
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Results also showed that gains in mean 
scores for the four groups corresponded closely 
to the amount of human relations training be- 
lieved to have been included in each of the four 
courses. Moreover, in general the mean score 
level of each successively more advanced group 
at the beginning of training corresponded 
closely to the level of human relations knowl- 
edge that each group could have been expected 
to have by virtue of the degree of human re- 
lations training it had received in the past. 
These results may be interpreted in either one, 
but not both, of two ways. If it is accepted 
that the courses in psychology were inculcating 
the attitudes and understandings that enter 
into good human relations, then the results 
may be taken to show some validity for How 
Supervise? as a test of such attitudes and 
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understandings. On the other hand, if How 


Supervise? is accepted as a test of the atti- 
tudes and understandings that enter into 
good human relations, then the results may be 
taken to show that the psychology courses, 
particularly the ones designed to do so, were 
in fact successfully inculcating such attitudes 
and understandings. 
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Measurement of Supervisory Ability 


Gerald C. Carter 


University of Illinois 


A battery of tests which consisted of The 
Personal Audit; How Supervise? Form A and 
B; Mechanical Comprehension Test Form AA; 
Kuder Preference Record; and the Otis Quick 
Scoring Mental Ability Test was given to the 
foremen and assistant foremen in two metal 
fabricating plants. Ratings by fellow super- 
visors were used as criteria of supervisory 
ability. Group A was composed of 15 foremen 
in the larger of the two plants. Group B was 
composed of 16 assistant foremen in the same 
plant and Group C was composed of 17 fore- 
men in the smaller of the two plants. Some 
of the supervisors did not take all of the tests. 
Therefore, the N varied somewhat from test to 
test. 

Criterion 


The number of fellow supervisors who did 
the rating in the larger plant was 27. The 
number of fellow supervisors who did the 
rating in the smaller plant was 15. 

The ratings were made by an open middle 
forced distribution technique. Each rater 
was given a sheet with the following direc- 
tions: “The results of this rating will be kept 
confidential. You are a plant superintendent 
given the task of selecting five supervisors from 
the following list of names. Write the names 
of the five men you would choose first. Write 
the names of the five men you would consider 
last. Omit your own name. Try not to let 
personal feelings affect your decision. Do not 
sign this paper.”’ 

The names of the supervisors in the three 
groups were placed on separate sheets. A 
score for each supervisor was obtained by as- 
signing three points for each time he was men- 
tioned in the first category, 1 point for each 
time he was mentioned in the last category, 
and 2 points for each time he was automatically 
placed in the open middle. The total of these 
points was then divided by the number of 
raters for that particular group and multi- 
plied by 10 to remove the decimal point. 

The uncorrected split-half reliabilities of 


o 


the ratings were computed and found to range 
from .75 for group B to .82 for group A. The 
reliability was .85 for the three groups com- 
bined. The criterion is more reliable than is 
usually found because it is a “pooled rating.”’ 


Results 


The coefficients of correlation between the 
criterion and scores on the Mechanical Compre- 
hension Test, Otis Quick Mental 
Ability Test, scores on each part of The 
Personal Audit, scores on each part of the 
Kuder Preference Record and scores on each 
part and total scores for Form A and B sepa- 
rately and combined for How Supervise? are 
shown in Table 1. 

The coefficients of correlation shown in 
Table 1 included all supervisors who had taken 
each test. Therefore, these coefficients differ 
somewhat from those shown in Table 2 be- 
cause these were recomputed to include only 
those supervisors who had taken all of the 
three best predictors for each group. If a 
supervisor had failed to take one of the tests 
used to obtain the multiple correlation for a 
group, his score had to be removed from cor- 
relation of the other two tests so that identical 
sets of individuals were used for each of these 
three tests. 

In order to determine the extent to which 
the three best predictors measured supervisory 
success as indicated by the ratings, coefficients 
of multiple correlation and their standard 
errors were computed for each group and for 
the three groups combined. Regression co- 
efficients and the regression equation were 
established for the three groups combined. 

The regression 


Scoring 


coefficients show relative 
weights of each of these three measures in 
contributing to the supervisory ability as 
measured by the pooled ratings of fellow 
supervisors. The regression equation may be 
used to predict the rating of any particular 
supervisor from the knowledge of his scores on 


each of the three best predictors. For in- 
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stance, if a prediction of the rating is to be 
made for Mr. X, his score of 21 on part three 
of How Supervise? Form A, his score of 31 on 
the artistic section of the Kuder Preference 
Record, his score of 32 on the Mechanical 
Comprehension Test are multiplied by the 
relative weights of these three factors. The 
sum of these products added to the constant 
gives the predicted rating. The equation for 
the predicted rating (P) for Mr. X is: 


P = 244 X 21+ .023 X 31 + .233 X 32+ 
5.107 = 18.4. 


It can be predicted that Mr. X should have 
a rating of 18.4. An examination of the actual 


Gerald C. Carter 


rating indicates that he received a pooled 
rating of 17 by his fellow supervisors. The 
coefficient of multiple correlation indicates 
the degree of accuracy of the prediction of the 
rating from the regression equation. These 
coefficients were .74 for group A, .80 for 
group B, .80 for group C and .84 for the three 
groups combined. 

The coefficient of multiple correlation for 
the three groups combined (.84) being quite 
high might give the erroneous impression that 
the predictors used to obtain it are highly 
effective for each of the three groups. How- 
ever, this is not true. Two of these predictors 
are ineffective for group A. 


Table 1 


Coefficients of Correlation between Criterion and Test Scores 





Group A 


N r 


Personal Audit 
Seriousness 13 -.63 
Firmness 13 
Tranquillity 13 — 42 
Frankness 13 A | 
Stability 13 
Tolerance 13 

Kuder Preference Record 
Mechanical 04 
Computational —.07 
Scientific 3 
Persuasive — 40 
Artistic 64 
Literary 
Musical .04 
Social Service .28 
Clerical 

How Supervise? 
Form A Part I 

Part II 

Part Ill 

Total 

Part I 

Part II 

Part III 

Total 

Part I 

Part I 

Part III 

Total 


Form B 
Form A&B 


Otis Test 
Mech. Compr., AA 


Group B Total Group 


Group C 


r N r N r 


14 .09 42 
15 43 
15 i 43 
15 d 43 
15 . 43 
14 i 41 
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Measurement of Supervisory Ability 


Table 2 


Uncorrected 
Split-Half 
Reliability 

of Criterion 


Number of Standard 
Supervisors Coefficient Error of 

Taking These of Multiple Multiple 
Three Tests Correlation C®orrelation 


Three Best Predictors with Coefficients of 
Correlation with Criterion 


Kuder Preference Record, Artistic (r = .66) 12 74 13 
Personal Audit, Seriousness (r= —.58) 


Group A 


Personal Audit, Tranquillity (r= —.40 


Group B How Supervise?, Part III, Form A+ Form B (r= .66) 
Personal Audit, Tolerance (r =.58) 


Kuder Preference Record, Social Service (r= 


Group ( How Supervise?, Part III, Form A (r=.65 
Kuder Preference Record, Clerical (r= — .47 


Kuder Preference Record, Musical (r= —.44) 
Total How Supervise?, Part III, Form A (r=.63 
Kuder Preference Record, Artistic (r =.13 


Bennett Mechanical Comprehension (r= .62) 


Although all of the coefficients of multiple 
correlations were surprisingly high, being in 
the order of the magnitude of the reliabilities 
of the criteria and of the tests, this should not 
be construed as evidence that any of the sets 
of three best predictors would necessarily be 
effective for predicting supervisory ability in 
general. The effectiveness of the predictors 
varied greatly from group to group. This is 
very probably due to the unstable zero order 
correlations and the tendency of multiple cor- 
relation to unduly magnify chance errors of 
measurement. Because of this variation a 


cross validation study should be made for 
every supervisory group for which predictors 
are desired. 

The results presented indicate that, at least 
in some instances, supervisory ability can be 
measured fairly accurately by psychological 
tests by selecting the best predictors from a 
relatively large number of likely indices (29 in 
this study). It is also necessary to have re- 
liable criteria such as pooled ratings by a 
large number of raters who know the super- 
visors being rated exceedingly well. 


Received February 13, 1952. 








Studies of Group Behavior: Factors Associated with the 
Productivity of Groups! 
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University of Minnesota 
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University of Illinois 


This is one of a series of papers reporting 
the results of a study of the relations among 
selected sociological and psychological vari- 
ables in the behavior of small, organized 
groups. The present phase of the total study 
deals with the analysis of factors related to 
group productivity. The groups studied com- 
prised thirteen women’s small residence units 
organized as a cooperative housing. project 
under the auspices of the University of Minne- 
sota. Background data on these small groups 
appear in items (1) and (2) of the References. 


The Criterion of Productivity 


During the course of the investigation, an 
attempt was made to get an estimate of the 
relative productivity of the groups when en- 
gaged in a common and meaningful task as a 
criterion measure against which to correlate 
certain group variables. 

While the cooperative housing project 
served primarily to provide room and board 
for the students at a lower cost than was else- 
available to them, the 
sought, by giving it full recognition as a stu- 


where University 


dent activity; to make the residence experience 
a worth-while phase of personal growth and 


' The studies to be reported in this and subsequent 
articles, under the general title of Studies of Group 
Behavior, have been carried on by the Laboratory for 
Research in Social Relations at the University of Min 
nesota under grants from the Graduate School; the 
College of Science, Literature, and the Arts; and from 
the Carnegie Corporation. They are part of a larger 
research program dealing with the broad problems of 
social responsibility. 

? Members of the Minnesota Laboratory at the time 
i the research. 


development for them. Problems of co- 
operative living were stressed in their broader 
implications for society generally. Against 
this background of a consciously-shared ex- 
perience, the experimenters proposed that 
each house prepare a ‘‘plan for better co- 
operative living in the Village.”” Each house 
was allowed one month during the spring 
term for the preparation of its report, as a 
house project and in conformity to a suggested 
standard outline. Cash prizes of $100, $75, 
$50, $35, and $25 were announced for the five 
top-ranking houses in the contest. Faculty 
members who agreed to serve as judges were 
asked to make an over-all ranking of the 
thirteen reports in the form of a single total 
judgment, and the criteria to be used by the 
judges were also given to the students at the 
start of the contest. 


The Independent Variables 


The predictor variables in such a study 
must bear some explicit or implicit relation to 
tentative hypotheses regarding factors asso- 
ciated with group productivity. As a first 
approximation, the problem was formulated 
in the following manner: 

All other things being equal, the produc- 
tivity of a group will depend upon the extent 
to which: A. the group goal is accepted; B. 
the previous group experience has been suc- 
cessful and satisfying; C. appropriate use is 
made of differential skills within the group 
membership; D. leadership is both accepted 
and persistent; and E. there are available 
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within the group individuals of requisite 
ability or special skill. 

Before describing the independent variables 
assumed to measure the behavior needed to 
test the above hypotheses, it is necessary to 
describe briefly one additional source of data, 
the participant-observer reports. The Uni- 
versity-assigned counselor in each house was 
asked to play the role of participant-observer 
during the month in which the reports were 
prepared. The tasks of the participant-ob- 
server were as follows: to prepare a narrative 
account of each house meeting held concerning 
the contest; to report on the attendance at 
each such meeting; to rate every participant 
at these meetings on a five-step scale for 
specified behavior. 

The narrative accounts of the meetings were 
designed to cover: enthusiasm for the task to 
be accomplished by the group; strength and 
sources of leadership in the task; type of leader- 
ship (democratic vs. authoritarian); evidences 
of conflict within the group; and organiza- 
tional efficiency with which the group carried 
out the task. The participant-observers rated 
each student present at each meeting on a 
five-step scale for: extent of participation in 
the meeting; usefulness of suggestions; co- 
operation; willingness to assume responsibility ; 
and leadership. 

The narrative reports submitted by the 
participant-observers were later independently 
analyzed by two raters, who used simple five- 
step scales (with step 1 being arbitrarily as- 
signed as the “good” score) to assess: strength 
of leadership; type of leadership (‘‘autocratic 
vs. democratic’’); efficiency of organization; 
evidences of interpersonal conflict ; enthusiasm; 
and amount of leadership provided by the 
counselor (who was also the participant-ob- 
server). These based on _ all 
narrative reports for each house, represented 
composite analyses of house behavior during 
the entire month of the contest; final house 
ranks were assigned by averaging the ranks 
assigned by the two raters for a particular 
variable for each meeting held by the group 
during the month of the contest. 

Returning now to the theoretical formula- 
tion of the problem, it is in order to list the 
kinds of data derived as measures of the inde- 
pendent variables related to productivity. 


assessments, 


These are listed herewith, under the five 


general behavior categories »* 


A. Acceptance of group goal: 
1. Volume of 


records) 
Extent of participation (as 
participant-observers) 

3. Assumption of responsibility (as rated 
by participant-observers) 
Enthusiasm for the task (as judged by 
case readers) 


participation (attendance 


rated by 


Success or satisfaction with previous group 
experiences: 


5. Satisfaction with Village life (from auto- 
biographical reports) 

6. House dislike ratio (from end-of-year 
sociometric schedules) 

7. House ratio of in-group to out-group 
choices for ‘‘social support’’ (from start- 
of-year sociometric schedules) 

8. House ratio of in-group to out-group 
choices for ‘‘confidantes” (from start-of- 
year sociometric schedules) 

9. House ratio of in-group to out-group 
choices for ‘intimate friends” (from end- 
of-year sociometric schedules) 

10. Evidence of personality conflict (as 
judged by case readers) 


and E. Availability of essential skills and 
appropriate use of such skills: 

(These two dimensions are treated to- 
gether in the following list.) 


11. House scholastic achievement 
end-of-year grade average) 

12. Efficiency of house organization for the 
contest (as judged by case readers) 

13. Usefulness of suggestions (as rated by 
participant-observers) 

14. Contribution to the contest (from end- 
of-year sociometric schedules) 


(house 


D. Patterns of leadership: 


15. Strength of leadership (as judged by case 
readers) 

16. Type of leadership 
readers) 

17. The leader role of the 
judged by case readers) 

18. Support of formal leader (from end-of- 
year sociometric schedule) 


is judged by case 


counselor (as 


5 Definitions of these 18 variables and Table 4 con- 
taining their house means and ranks have been filed 
with the American Documentation Institute. Order 
Document 3616 from American Documentation Insti- 
tute, 1719 N Street, N.W., Washington 6, D. C., re- 
mitting $1.00 for microfilm (images 1 inch high on 
standard 35 mm. motion picture film) or $1.20 for 
photocopies (6X8 inches) readable without optical aid. 
A longer manuscript of the report also is available for 
reference from the senior author. 
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These variables range all the way from 
clearly objective data (school grades and at- 
tendance data for house meetings) to more or 
less tenuous and possibly unstable measures of 
interpersonal] relations from sociometric sched- 
ules. The interactions in each house are, 
furthermore, seen through the eyes of three 
different sets of observers: the students them- 
selves who were participating in the contest; 
the participant-observers, who, with minimal 
training, were recording house progress during 
the contest as well as participating; and the 
two judges who were the only ones to have a 
view of all participant-observer reports, for 
purposes of comparing the houses on defined 
behavior. 

Because:the basic N for the sample of houses 
is thirteen, rank-order correlations must be 
used as the approximate estimate of relation- 
ships. Implicit in this procedure is the as- 
sumption that the behavior of a particular 
house can be indexed by averaging behavior 
measures for its membership of seven to six- 
teen students taken singly, i.e., that the group 
is merely the average of its component parts, 
disregarding the variability of the component 
members around the group average. An 
alternative assumption, and one equally crucial 
to test, is that the group’s behavior in certain 
areas is best indexed by minimum variability 
around a known average position, as would be 
the case, for example, in estimating the pos- 
sibility of change in attitudes for a group show- 
ing a strong original attitude in opposition to 
prevailing authority, accompanied by a small 
standard deviation around the mean opposi- 
tion score. 

A further assumption, more directly amen- 
able to testing in this study, concerns the 
varieties of behavior defined by the eighteen 
independent variables. were defined 
and grouped on essentially logical grounds 
at various stages of the year’s field study. As 
a first approximation, therefore, the behaviors 
so defined and grouped should show relatively 
high patterns of intercorrelations within a 
group and relatively low correlations with be- 
haviors from other groups, if our formulations 
are to have meaning. More specifically, any 
two independent variables which appear to be 
closely related logically and operationally 


These 
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might be expected to show a sufficiently high 
intercorrelation to be interpreted as a meas- 
ure of the reliability of two assessment 
methods. Where such expectations fail to 
materialize, either the variables observed 
derive from different domains of behavior, in 
spite of the a priori logic by which they were 
grouped, or the methods of measuring the 
variables are insufficiently precise, or the 
variables, while relatively unrelated, may 
still tap effectively component parts of the 
criterion measure and might show a substantial 
loading of a more general factor underlying 
the total matrix. 


Results 


The Criterion. Table 1 lists the rankings 
assigned by each of five faculty judges to the 
final reports prepared by each of the thirteen 
houses. Judges 3 and 4 appear to deviate 
most markedly from the remaining three 
judges in their evaluations. However, on the 
basis of the average ranking of the five judges, 
Houses M, E, D, K, and G, respectively, were 
awarded the announced cash prizes as soon as 
possible after the judges had made their 
independent reports to the research team and 
before the intercorrelations of judges had been 
determined. 


Table 1 


Ranks Assigned by Each Judge to Essays Produced 
by Specified House Unit* 


Judge 


2 


House 3 


> 


i 


6 


9. 
4. 


7 


11.0 
6.5 
4.5 

13.0 
2.0 

12.0 
8.0 
6.5 
3.0 
9.5 
1.0 


- 


_ 
— 
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oO 
_ 
-™ mM 


* The five cash prizes were awarded to Houses M, E, 
D, K, and G, respectively. 
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Table 2, showing the rank-order intercor- 
relations between all pairs of judges, indicates 
more clearly the degrees of agreement. The 
average intercorrelation of Table 2, based on 
five judges, is .59. Averaging the intercor- 
relations of Judges 1, 2, and 5, the resultant 
value is .85. Because these three judges 
showed a greater comparability and con- 
sistency in their evaluations, their rankings 
only have been used in the more detailed analy- 
ses of the factors associated with the produc- 
tivity of the groups. 

Another aspect of the criterion should be 
mentioned briefly. While the residents of the 
Village participated quite willingly in the task 
imposed by the experimenters, even to the 
extent of requesting that their detailed sug- 
gestions for improvement be sent anonymously 
at the end of the contest to the University 
administration, the task toward which they 
directed their energies involved essentially a 
verbal formulation and expression of situations 
they had self-consciously been experiencing 
and discussing throughout the year. The 
better performers in preparing such a report 
might therefore be the “better” group, on any 
one of a number of scales of “goodness” as a 
well-satisfied, well-organized residence unit. 
Had the members of each house been faced 
with a task unrelated to their experiences of 
living together, the resultant criterion meas- 
ure might show an entirely different set of 
relations to the same independent variables or 
the maintenance of the same relative weights 
at a much lower level of absolute predictive 
power. 

These reservations about the criterion can 
be viewed in at least two ways. First, one 
might argue that the results of the study can- 
not be generalized—that group forces relating 
to productivity cannot be presumed to operate 
independently of the content of the task 
toward which the group is oriented as the 
criterion measure. Alternatively, one might 
argue that the predictor variables will retain 
their relative weights for any dependent 
(criterion) variable of approximately the same 


degree of relevance to the group. Relevance, 


in this sense, becomes the crucial property or 
quality of the criterion task to be perceived by 
the participants and transcends the task itself 


Table 2 


Rank-Order Intercorrelations between Pairs of Judges 
in Evaluating House Essays 


Judge 


Average rho, 5 judges = .59. Average rho, Judges 1, 
2, and 5 = .85. 


to a degree that will permit generalization. 
The property of relevance might be com- 
pounded of no less than the following elements: 
the group’s perception of the importance of 
the task; the group’s desire to accomplish the 
task; the group’s confidence that its members 
know how to do the task. 

The Predictor Variables. All house averages 
on the criterion variable, and also on the 
eighteen predictor variables previously de- 
scribed, were obtained and used in arriving at 
the rank-order correlations set forth in Tables 
3 and 4.4 By reference to the list of variables 
given earlier, it is possible to study the cate- 
gories of predictor variables and to make some 
observations regarding the consistency with 
which certain behaviors were observed in this 
study. 

Variables 4, 10, 12, 15, 16, and 17 in Table 3 
resulted from the average ratings of two in- 
dependent judges, who read all the participant- 
observer reports and rated them for the 
variables involved. The degree of agreement 
between these two judges in assigning house 
ratings to these reports is shown in Table 5. 

In assessing strength of leadership, efficiency 
of organization for the task, and degree of 
enthusiasm of the participants, the judges are 
in substantial agreement, although they show 
less agreement for the other three variables. 

Variables 2, 3, and 13 are derived from 
ratings made after each meeting by the partici- 
pant-observers, who rated each girl in attend- 
ance, including themselves, on a five-step scale 

' Table 4, giving house averages, and resultant ranks, 


has been filed with the American Documentation Insti 
tute. See footnote 3. 
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Table 5 


Rank-Order Correlations of Ratings of Participant- 
Observers’ Reports by Two Judges 
(N = 13 
Variable 
Enthusiasm for task 
Evidence of personality conflict 
Efficiency of house organization 
Strength of leadership 
Type of leadership 
Leader role of counselor (also 
participant-observer) 


for the behavior in question. It is evident 
from the high intercorrelations of these three 
variables in Table 3 that the participant-ob- 
servers seem to be working within the frame- 
work of a general halo about the girls under 
their observation, with insufficient specificity. 

Variable 14 represents the judgment of the 
actual participants in each house regarding 
their own contributions and the contributions 
of their house-mates in the task of preparing 
the report. This variable might be expected 
to show a marked degree of agreement with 
the judgments of the participant-observers, as 
indexed in Variables 2, 3, and 13. In looking 
at the three relevant correlations, however, it 
would not appear that the participants them- 
selves and the participant-observers were in 
close agreement on the behavior under con- 
sideration. Nor does the girls’ evaluation of 
each other’s contributions relate closely to the 
ratings of the judges who saw the progress of 
the contest through the narrative reports sub- 
mitted by the participant-observers (Variable 
14 vs. Variables 4, 10, 12, 15, 16, and 17). 

There does not appear to be extremely high 
agreement among the participants, the partici- 
pant-observers, and the judges who reviewed 
the entire range of participant-observer re- 
ports in the assessment of behaviors that on a 
priori grounds appear to be related. Whether 
this may be due to poor training of the raters, 
disjunctions between relative and absolute 
judgments, or psychological differences be- 
tween apparently similar behaviors cannot be 
determined from the data. It is likely that 
all three of these factors contribute to the low 
patterns of intercorrelations. 
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Table 3 also permits an analysis of the com- 
munality of the groups of predictor variables. 
Under the general rubric of “acceptance of the 
group goal,” for example, four specific vari- 
ables are included: volume of participation; 
extent of participation; assumption of re- 
sponsibility; and enthusiasm for the task. 
The six possible intercorrelations among these 
four variables appear near the top of Table 3. 
The average intercorrelation for this set of 
six, including the negative correlation, is ap- 
proximately .40—a correlation that does not 
warrant any assumption of great communality 
among the variables logically grouped as facets 
or coordinates of the general concept of ‘‘ac- 
ceptance of the group goal.” Furthermore, 
these four variables show a wide range of 
correlation with the criterion measure; only 
one of the four—enthusiasm—approximates a 
relationship significantly greater than zero for 
the N of 13. 

Similar statements can be made about the 
other groups of predictor variables, with re- 
spect to their patterns of intercorrelations as 
well as their correlations with the criterion 
variable. 

These data have some bearing on the con- 
ceptualization phase of designing experiments 
on small groups, since the concept is in part 
given meaning by the choice of behavior 
deemed to be coordinate with it. In Table 
3, for example, six possible behavioral indices 
of “satisfaction with previous group experi- 
ence” are presented, and the intercorrelations 
among them are shown. In addition, when 
each is correlated with the criterion, only two 
(satisfaction with Village life and ratio of in- 
group to out-group choices for “social sup- 
port” on the first sociometric schedule) ap- 
proximate significance in predicting produc- 
tivity with the N of 13. A posteriori, some 
of the attenuating factors become evident: 
the six behavioral indices from 
different time points in the experimental 
year; they are assessed or measured with 
indeterminate accuracy and by different ob- 
servers; they are drawn from behavioral 
domains, in terms of low intercorrelations of 


are drawn 


sociometric data, showing considerable and 
surprising specificity (2). 

The problem of identification, accurate as- 
sessment, and meaning of variables, is certainly 
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not a new one in psychology; it applies with 
equal cogency in research on groups as well as 
research on individuals and it emphasizes the 
importance of careful derivations of behavioral 
coordinates in testing the relationships in- 
volved in group processes. 

The Predictions of Productivity. Table 3 
permits the choice of several possible com- 
binations of variables for use in a multiple 
regression equation, in such a way that the 
earlier hypothetical formulation can be sup- 
ported with varying degrees of confidence. 
For example, the Wherry-Doolittle shrinkage 
formula® can be used to estimate the R with 
productivity that might be obtained from a 
multiple containing: volume of participation; 
satisfaction with Village life; achievement; 
and percentage of votes received by the formal 
leader. These four variables commend them- 
selves as relatively objective measures of 
factors crucial to the test of the general formu- 
lation of the problem as given at the start of 
this paper. Two of these four give as an 
estimate of R a value of .676; these two are: 
satisfaction with Village life and percentage 
of votes received by the formal leader. The 
addition of the other two variables shrinks 
the results to a lower estimate of K. 

But the following three variables give an 
estimated R of .867: satisfaction with Village 
life; percentage of votes received by the formal 
leader; and ratio of in-group to out-group 
choices for “social support” on the sociometric 
questionnaire given at the start of the school 
year. Note that two of these three variables 
are drawn from the same category of variables, 
dealing with “satisfaction with previous group 
experiences.” 

An estimated R of .88 is obtained by use of 
the following four variables: enthusiasm as 
estimated by the judges who read the partici 
pant-observers’ reports; evidence of personality 
conflict as seen by the same judges; efficiency 
of house organization for the contest; and 

5 Stead, W. H., Shartle, C. 
counseling techniques. New York: American Book 
Company, 1940, pp. 245-51. The assumption that 
rank-order correlations are direct equivalents of Pear- 
sonian values has been made in using this formula, 
even though the authors realize it is open to question, 
since the problem here is the relative changes in R esti- 


mates from alternative selections of variables in the 
same matrix 


L., et al. Occupational 
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amount of leadership judged to have been 
exercised by the counselor. 

Another estimated R has been established 
on still another combination of variables, each 
of which is drawn from one of the four general 
rubrics of the original hypothetical formulation 
and each of which shows a substantial corre- 
lation with the criterion of productivity: 
enthusiasm for the task; satisfaction with 
Village life; efficiency of organization for the 
task; and percentage of votes received by the 
formal leader. The R value is .896. When 
an estimated R is computed using only three 
of these four variables (satisfaction, efficiency 
and formal leadership support) the multiple 
R becomes .904. 

It appears that in this particular experi- 
mental setting and with the criterion task here 
defined, it is possible to identify factors con- 
tributing to the relative productivity of the 
thirteen groups. The estimated R’s will 
differ according to the variables chosen for 
inclusion in the formula; in one instance, at 
least, a set of variables not on a priori grounds 
completely consonant with the conceptualiza- 
tion yields a higher estimated R than sets of 
variables more closely related to the hypotheses 
on logical grounds. However, since one vari- 
able alone—efficiency of house organization 
carries the greatest predictive weight, the 
multiple regression solution is somewhat un- 
economical here. The study has raised more 
problems than it has solved, one of which 
warrants mention. The multiple regression 
solution assumes a linear and additive relation 
between the independent variables and the 
criterion; it requires also that enough inde- 
pendent variables be included to account for 
all or almost all criterion components. Even 
if, in replications, the criterion components 
have varying weights for other samples of 
groups, the beta weights of the independent 
variables should still remain relatively con- 
stant. It is essential, however, to consider 
whether productivity is a linear and additive 
resultant of various group factors that can be 
hypothesized, or whether alternative formu- 
lations are closer to the reality of group be- 
havior. 

If linearity is assumed, a possible next step 
in the present study would be the factorial 
reduction of the variables represented in Table 
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3, including the criterion variable. This 
solution, however, would be meaningful only 
to the extent that one is dealing with reliably 
estimated and conceptually relevant behaviors 
of a sample of groups known to be repre- 
sentative of some population of groups, and 
to the further extent that the criterion is 
truly a meaningful task for the groups in- 
volved. 

As a result of discussions of such problems 
of group productivity, Schachter set up a more 
incisive experiment on the relations between 
cohesiveness and effect of group induction to 
maximize or restrict group productivity (3). 
His study should be read in connection with the 
present report, since it introduces a variable 
not dealt with here—differential effect of group 
induction in high and low cohesive groups. In 
brief, he finds no necessary relationship be- 
tween cohesiveness and high productivity. 
Group members will accept inductiqn either 
to increase or decrease production. Cohesive- 
ness appears to be a determining variable in 
the condition but not in the 
“speed-up” condition. When the group in- 


“slow-down”’ 


duces forces to increase production, both high 
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and low cohesive subjects accept group in- 
duction and increase their output markedly. 
When the group induces forces to decrease 
production, the high cohesive subjects are 
more accepting of group induction and conse- 
quently less productive than low ‘cohesive 
subjects. While the designs of these two 
studies are different, they deal with the same 
general problem and together may form the 
basis for further research on group produc- 
tivity. 
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MMPI Personality Patterns for Various Col'ege Major Groups 


Ralph D. Norman and Miriam Redlo 


The University of New Mexico 


A recent study by Daniels and Hunter (3) 
raises two questions which are important in 
guidance, namely, whether there are personal- 
ity patterns which gravitate toward certain 
occupations, and also whether there are fixed 
“personality demands” in various jobs. It 
is the purpose of the present research to ex- 
tend these questions to the college student and 
his choice of major subject. Do students who 
select a major in business, say, have certain 
personality characteristics in common and are 
they different from those who choose art or 
psychology? It was decided to use the 
MMPI to help answer these questions since 
it has validity in pointing out vocational 
personality trends (1, 8, 12, 22, 23), although 
Lough (13, 14) expresses doubt about this. 


Subjects and Procedure 


Subjects were 149 male seniors and graduate 
students at The University of New Mexico, 
chosen on the assumption that if personality is 
related to choice of major, the advanced stu- 
dents would exhibit the most pronounced char- 
acteristics. They were distributed as follows: 
psychology, 17; sociology, 3; mathematics, 2; 
chemistry, 4; physics, 12; engineering, 29; 
anthropology, 22; business administration, 23; 
art, 16; music, 1; geology, 8; biology, 4; physi- 
cal education, 2; history, 3; English, 1; ele- 
mentary education, 1; Inter-American Affairs, 
1. These majors were grouped together be- 
cause of logical relationships into seven major 
groupings: psychology-sociology (PS), 20; 
mathematics-chemistry-physics (MCP), 18; 
engineering (Engr), 29; anthropology (Anth), 
22; business administration (BA), 23; art-music 
(AM), 17; geology (Geol), 8. The remainder 
constituted a miscellaneous grouping which 
was not contrasted with the others because of 
its heterogeneity, except that it was included 
in the total group when each grouping was 
contrasted with the total minus itself. 

All Ss took the MMPI, and completed a 
questionnaire, rating their degree of satisfac- 
tion with their major on a 7-point scale and 
indicating which major they would choose if 
they could reselect it. These latter data were 
used because it was hypothesized that those 
who indicated greatest satisfaction would ex- 
hibit the most definite or pronounced -person- 


ality pattern for their own grouping. Simi- 
larly, those rechoosing the same or similar 
majors, it was felt, should be more like their 
own grouping than those rechoosing differently. 

Results from the attitude scale revealed that 
it differentiated in numbers largely between 
“Strongly satisfied’’ and ‘“‘satisfied” or less, 
probably because of natural reluctance to ad- 
mit dissatisfaction with major after one had 
spent considerable time and effort with it. 
Data for all 149 cases showed the follow- 
ing distribution: strongly dissatisfied, 0; dis- 
satisfied, 0; mildly dissatisfied, 3; neutral, 4; 
mildly satisfied, 14; satisfied, 66; strongly sat- 
isfied, 62. Consequently, it was decided to 
compare the strongly satisfied (hereafter SS) 
groups within each major against the satisfied- 
and-less (hereafter LS). 

Also, data on rechoice of major were ana- 
lyzed into 3 categories: ‘‘different’’ (e.g., a 
student might indicate a rechoice of a com- 
pletely different major, as from Engr to BA); 
“different but similar’ (e.g., a rechoice of 
chemistry instead of physics); and ‘‘same.” 
Two “undecided” cases were not used, nor was 
the Misc grouping, the reason therefor being 
evident below. 

By use of the ¢ test, the mean score of each 
major grouping was compared with the mean 
score of every other major grouping on all 
MMPI Scales (except ? Scale); also, the mean 
score of each grouping was compared with the 
mean of the total group less the grouping in 
question. Similarly, the means of SS groups 
were contrasted with those of LS for each 
major grouping and for the total group. Sta- 
tistical analysis of the data concerned with 
rechoosing majors was more difficult since the 
numbers in the categories (other than ‘‘same’’) 
were very small. Hence it was decided to use 
the mean T-score deviation on each scale from 
the mean T-score of the related major grouping. 
The trend of deviations might then suggest 
whether or not those who would rechoose 
different majors deviate more markedly from 
the means of their major groupings than those 
who would reselect the same major. 


Results 


1. Results for Major Groupings Compared with 
Each Other and with “Total.”! Table 1 
presents the means and sigmas of T-scores of 


‘Total’. refers to the total group of 149 minus the 
particular subgrouping. 
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Table 1 


Means and Sigmas of 7-Scores of E 
Major Grouping K 
Psychology and 5 
Sociology 


Mathematics, Chem. 
and Physics 


Engineering 

Anthropology 

Business Adminis 
tration 

Art and Music 


Geology 


Total Group (includ. 
12 Misc. Majors) 





* Raw scores. 


each major grouping and the total group of 149 
on the MMPI Table 2 lists the significant 
differences, checked for homogeneity of vari- 
ance, among the major groupings, and between 
the particular major grouping and the “total” 
group. Significant differences, discussed later, 
appear for all scales except Pt and Hs. 

2. Results for SS Compared with LS. No 
significant differences appeared when means 
for these 2 groups were compared within each 
grouping. The small .V’s and perhaps our 
manner of dichotomizing the groups may have 
affected this approach. Accordingly another 
approach was tried. In Table 2, 8 instances 
occurred wherein the scales discriminated be- 
tween the particular major grouping and the 
“total.” It might then be hypothesized that 
the SS group within each major should have 
mean score in relation (i.e., higher or 
lower than) that of the LS group similar to 
that of the major grouping itself in relation to 
“total.” Table 3 gives results of this contrast. 
According to Table 3, the prediction holds in 


a to 


? Except for Z and F Scales which are reported in raw 
score form since Hathaway and Meehl (11) state the 
original 7-score tables for these were inaccurate 


Hs 
3.7 
33 


‘ach Major Grouping and Total Group on the MMPI 


D Hy Pa Pi Sc 


58.9 48.7 
6.7 5.4 7.1 


uf 
59.0 


4.4 


55.1 
7.6 


5.8 


) 


56.9 
6.7 


52.8 
8.0 


5.3 
l 


5 cases, falls down in 2 and is indecisive in 1 
(Pa for PS) where the two means are almost 
identical. The best conclusion we may make 
here is that there is a tendency for SS groups 
to be more like their own major groupings on 
certain discriminative scales than LS groups. 

When the total group of 149 students was 
divided into SS and LS, 2 statistically sig- 
nificant MMPI differences emerged. Regard- 
less of major, the 65 in the SS group exhibit 
more feminine interests (Mf mean 65.02) 
than do the 87 in the LS group (Mf mean 
61.01), the difference being significant at the 
2 per cent level (¢ of 2.42). In addition, the 
SS group was significantly less psychasthenic 
(Pt mean 54.85) than the LS group (Pt mean 
58.23), the difference being significant at the 
5 per cent level (¢ of 2.17). The SS group 
also had a significantly higher major grade 
point average (2.23) than the LS group 
(1.79), the ¢ being 4.40, P < .001. 

3. Results Concerned with Rechoosing Majors. 
As noted above, it was possible, when students 
were asked about rechoice, to separate each 
grouping into 3 categories. In view of small- 
ness of .V’s, no statistical technique was em- 
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Table 2 


Significant Differences (t’s) betwee 


L I 


PS, Anth, 
Engr, 
Tot, 


78** 


WY ig 


Engr< MCP< 


Tot . 


Pd Mf 


K 
AM, 
Geol, 


Pa 


n Major Groupings on the MMPI 


D 


Hy 


macy’,,3.2i” 
Anth, 2.: 
Tot, 2.99**t 


7* 
‘ 


AM> Engr, 2.19* 


Se Ma 


PS, 

MCP,: 
Anth, 3.07** 
BA, 4.41** 
Geol, 2.39* 
Engr, 4.38** 
Tot, 4.71** 


MCP, 
Engr, 
Anth, 


30*t 
35* 
41*t 


AM> 


Anth> Engr, 
Engr < Tot, 


Tot = Total group minus contrasted subgroup. 
* Significant at .05 level. 

** Significant at .01 level. 

t Corrected for heterogeneity of variance. 


ployed to test for significance but in 5 of 7 
instances (all except Anth and Engr), those 
students who would select different majors if 
given the opportunity to choose again deviated 
more from their own major grouping than those 
who would rechoose the same major. The 
trend is perhaps more pronounced if the total 
group of 135 who made a definite rechoice is 
considered. Mean T-score deviation from 
major grouping is greatest for “different” 
(V = 13), M = 7.55; next greatest for ‘‘differ- 


Table 3 


Strongly Satistied (SS) Compared with 
Satisfied-and-Less (LS) 

LS Predic- 
tion 
Verified? 
No 
Yes 
Yes 
Yes 
i CR... 

>? 
No 
Yes 


Prediction from 
Table 2 


~ 


VU 


L 5 
F 
D 
Uf 
uf 
Pa 
Sc 
Va 


AM> “total” 
Engr < “total” 
BA<“total” 
AM> “total” 
Engr < “‘total’”’ 
PS<“total” 
MCP < “total” 
Engr < “total” 


q ¥ | 
24 3.6 
15 50.1 
3 68.3 
2deo 59.9... 
13 48.6 
14 51.6 
24 54.7 


wn 


—_ 
we SN & 


= 


_— 


ow 
+N 


nance vs 


wn 
os 


3.40° 
2.58* 
25° 
4.84** 
3.34** 

AM > Engr, 


PS, 

BA, 
Engr< | AM, 

Geol, 


Tot, 


PS, 
AM, 
Tot, 


2.30* 
3.07** 
1.96* 


MCP< 


NNN NWN Ww 


2.26* 


ent but similar” (V = 8), M = 7.28; and 
least for ‘“‘same”’ (.V = 114), M = 6.60. These 
results must be considered suggestive rather 
than conclusive of the fact that personality 
needs exist in academic choice. 


Discussion 


Discussion of results will not be concerned 
with explaining every significant difference in 
Table 2, for when 336 different /’s are run, it 
is possible that some may reach a level of 
significance by chance. Rather, to be con- 
servative, it would be more pertinent to dis- 
cuss trends evidenced in Table 2 where sig- 
nificant differences were found at least 3 times 
between a grouping &nd other groupings or 
between a major grouping and the total. 

1. Lie Scale. On this scale, AM sig- 
nificantly greater than PS, Engr, and “‘total.”’ 
Although this scale has not been analyzed 
clinically, Hathaway and McKinley (10) state 
that high Z results when the subject chooses 
make him most socially 
acceptable. It is of interest here that Grayson 
(7) points out that high Z is usually accom- 
panied by high Hy. The AM grouping shows 


1S 


which 


-~fesponses 
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both highest Z and highest Hy, and on both 
scales differs significantly from Engr which 
has lowest L and Hy. Lying and hysterical 
reactions are both socially oriented, implying 
sensitivity for applause of the crowd, a need 
which is probably greater in artists than 
engineers (e.g., artists put their products 
on public display). Moreover, the artist 
converts reality into fantasy, and from his 
earliest training precise regard for realism is 
not encouraged. This is quite the opposite of 
Engr’s training. 

2. F Scale. On this scale, Engr is sig- 
nificantly ower than ‘“‘total.”” Hathaway and 
McKinley (10) contend that high F may be 
due to carelessness and low F indicates that 
S’s responses were rational and relatively 
pertinent. Engineering is a precise, careful, 
rational field, completely pertinent to practical 
matters. It is indeed possible that the low F 
of Engr is a carry-over of his training. It is 
of interest here that Cook and Wherry (2) 
found a Mechanical Coordination Factor, 
resulting from a factor analysis of MMPI and 
aptitude tests, had a signifieant positive load- 
ing on F. They state that subjects with good 
mechanical coordination were meticulous in 
answering personality questions. 

3. D Scale. BA is significantly lower than 
MCP, Anth, AM, and “total.”’ Our results 
are similar to those of Paterson (15), Trabue 
(21), and Dodge (5, 6) who found sales-people 
highly socially dominant. Harrower and Cox 
(9) found insurance salesmen giving evidence 
of considerable drive. As compared to other 
groups, the presence of depressive trends in 
BA would be a definitely serious liability. 

4. Pd Scale. PS scores significantly greater 
than MCP, Engr, Anth, and “total.” It 
seems paradoxical that PS should have a 
higher Pd implying a tendency toward psycho- 
pathic characteristics. Perhaps the best ex- 
planation is rather obvious. In the psycho- 
path, freedom of expression is paramount—he 
defies convention and tradition. Since soci- 
ology and psychology attempt to blame many 
of the present taboos for mental illness and 
social problems, it is possible that the PS 
group feels that it must defy convention. Or 
perhaps as a result of training PS does not feel 
any reluctance about answering Pd items 
truthfully or may even interpret them differ- 
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ently. These attitudes would be picked up 
by an inventory like the MMPI. 

5. Mf Scale. AM is significantly greater 
than all other groupings and “‘total.”” A valid 
explanation would be that sensitive or cultural 
work has been characterized as feminine, and 
since art requires both, AM will naturally 
exhibit higher Mf. Roe (17), studying artists, 
states that they have a type adaptation which 
is decidedly non-aggressive, hence more femi- 
nine than masculine. However, she does state 
further that passivity is more characteristic of 
intellectual males; this statement is in line 
with our finding that Mf is the highest of all 
for our total group of 149. On this scale also 
Engr scores significantly lower than ‘total,’ 
a not unexpected result in view of the “‘mascu- 
linity” of engineering. Cook and Wherry (2) 
found a negative loading on 
aptitude for those with high Mf. 

6. Pa Scale. 


mechanical 


PS scores significantly lower 
than all other groups (except Geol), and 
“total.” It that no explanation in 
terms of personality is required. The sophis- 
tication of PS enables it to select out the Pa 
questions, especially in view of the fact that 
the paranoid is a dramatic type. 

7. Sc Scale. MCP is significantly lower 
than PS, AM, Geol, and “‘total.”’ It is prob- 
ably true that the reality of MCP represents a 
rather unique reality as compared to less pure 
and emotionally rarefied fields. The nature 
of this reality is in no way comparable, how- 
ever, to schizoid reality. The former is 
logical, rational, intellectual and highly 
stract, while the latter is bizarre, irrational, 
emotional and concrete. 

8. Ma Scale. Engr scores significantly 
lower than PS, BA, AM, Geol, and ‘“‘total.”’ 
Daniels and Hunter (3) state that the work 
needs of the Ma pattern are related to an outlet 
for enthusiasm and a high degree of overt 
activity. ,; We feel that both MCP and Engr 
require the least overt activity in comparison 
to other groups; they do not require as much 
social orientation as PS, e.g., or as strong an 
outlet for enthusiasm as AM, BA, or Geol. 
The engineer, and also MCP, have a definite 
concept of reality and their place in it, and 
therefore, unlike the hypomanic individual 
they do not shift their attention constantly. 
However, our results on Engr and the Ma 


seems 
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Scale appear at variance with a finding by 
Cook and Wherry (2). They found a factor 
labeled Tendency to Over-Activity with posi- 
tive loadings on mechanical aptitude and 
knowledge, and state that over-active indi- 
viduals find outlet in mechanical pursuits. 
However, the difference between their sub- 
jects, naval enlisted submarine candidates, 
and ours may explain this discrepancy. 

An attempt may now be made to describe 
tentatively each academic group in terms of 
personality characteristics or of personality 
demands of the major. 

1. PS. This group creates ‘somewhat of a 
problem since their knowledge of psycho- 
logical dynamics may have contaminated 
their profiles. The MMPI indicates that, as 
a group, PS may be characterized by fairly 
strong Pd tendencies and corresponding Ma 
behavior. Roughly, their orientation is out- 
going with expressed disregard for convention. 

2. MCP. This group indicates a pattern 
of tendencies away from Pd and Ma, with 
somewhat high D and very low Sc. Justifica- 
tion for this pattern may be found in Roe’s 
Rorschach work on scientists. She believes 
that men with dominantly non-verbal ability, 
who seem to find satisfaction in empathy with 
symbols of things rather than things them- 
selves, are men who are suited for and at- 
tracted to science (19). Therefore, for MCP, 
the conclusion might be suggested that very 
weak Pd, Ma, and Sc tendencies are necessary 
for success since these sciences are concerned 
with symbols, ideas, and abstraction, rather 
than with people. The exacting nature of 
these sciences may contribute to the presence 
of somewhat higher D, a finding similar to 
that of Roe (20), who reports physicists with a 
high degree of anxiety because of the nature 
of their work. 

3. Engr. Tendencies similar to MCP are 
found in Engr. This group displays very low 
Pd, Ma, and Hy. Their Sc is a little higher 
than MCP, but lower than the other groups. 
Explanations similar to those given for MCP 
appear to apply to engineers, except that they 
are the most “masculine” (lowest Mf), a find- 
ing to be expected in view of their mechanical 
interests. The personality demands of this 
group seem to imply a stability of behavior, 
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low overt activity, reduced interest in people, 
and masculinity. 

4. Anth. This group does not indicate 
strong patterns. Anth has a relatively high 
Mf score which could mean that this field re- 
quires a high degree of sensitivity, a finding in 
agreement with that of Roe (18) in her study 
of vertebrate paleontologists. 

5. BA. As a group, BA may be charac- 
terized by low D, accompanied by Ma tendency 
and social aggression, a factor resulting from 
the comparatively low Mf score. It is obvious 
that the business world demands the opposite 
of what McKinley and Hathaway (10) say 
about high D, namely, “poor morale . . . feel- 
ing of uselessness . . . inability to assume 
normal optimism.”’ Business also demands 
aggressive tendencies which should show up 
in lower Mf. 

6. AM. This group is represented by a 
complexity, of characteristics. Extremely 
strong feminine sensitivity (high Mf) is ac- 
companied by high Hy, Sc, Pd, Ma, and 
somewhat Pa tendencies. The generally high 
mean scores of AM suggest that, as a group, it 
is somewhat more maladjusted than the others, 
and may find outlets through artistic sub- 


limations or compensations as suggested by 


Prados (16). In view of the complex pattern 
of AM, it is difficult to state any personality 
demands for it, except the high femininity. 

Because of the small .V in Geol, no attempt 
will be made to define personality character- 
istics or demands. However, these few cases 
are not similar to MCP, but we cannot con- 
clude whether or not this is an artifact of 
our sampling. 

This study also noted the fact that SS stu- 
dents were significantly higher in Mf than LS. 
Since it has been demonstrated before (4) that 
college males have Mf scores higher than 
average males, this result is not surprising. 
Roe (17) states that feministic adaptation is 
characteristic of the sensitive intelligent male, 
and that intellectual pursuits become a refuge 
for men who deviate from the pattern of mascu- 
linity. College work would thus be more 
satisfying to the somewhat: more feminine 
male. 

We have also noted that LS scores sig- 


nificantly higher than SS on Pt. Hathaway 
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and McKinley (10) state that a Pt tendency 
may be manifested via mild depression, ex- 
cessive worry, lack of confidence, and in- 
ability to concentrate. These  character- 
istics should certainly be less prominent 


among SS students than among LS. 

Since ours is an exploratory study, with 
small .V’s, we cannot suggest that patterns 
found here be used for guidance purposes. 
Research on a much larger scale is needed in 
order to confirm and expand these findings. 


Summary 


Seven groupings of students majoring in 
different academic subjects were contrasted 
with each other and with a “total” grouping 
minus the particular subgrouping on the 
MMPI. They also rated their satisfaction 
with their major subject and mentioned their 
choice of major if allowed to rechoose. _ Princi- 
pal findings were: 


1. The MMPI is valid for distinguishing 
personality trends amongst various major 
groupings. Certain scales significantly dis- 
criminated major groupings from the _ re- 
mainder of the students. 

2. There is a tendency for students who are 
strongly satisfied with their major to resemble 
their own groupings on discriminative scales. 

3. Significant differences were found be- 
tween strongly satisfied and satisfied-and-less 
students on Mf and Pt. The former were 
higher on Mf, the latter on Pt. 

4. When mean T-score deviations from 
average T-scores are calculated, there is a 
tendency for students who would rechoose the 
same major to deviate less from their own 
groupings than those who would rechoose a 
different major. 


Received December 24, 1451. 
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The Effects of Tachistoscopic Training in an Adult Reading Program ' 


George Manolakes 


Division of Research, State Education Department, University of the State of New York 


The role of the tachistoscope in a reading 
improvement program has been the subject of 
much discussion. Since the tachistoscope has 
been one of the training devices used in the 
Reading Improvement course at the Marine 
Corps Supply Schools, this study was initiated 
in order to determine the effects of omitting ta- 
chistoscopic training from the course of in- 
struction. 


Design of Experiment 


Accordingly, a study was designed which 
would provide for an Experimental and a 
Control group to undergo training in reading 
improvement simultaneously. The variable 
element within their instruction was the ex- 
clusion of tachistoscopic training from the pro- 
gram of the Experimental group, and the ex- 
tension of instruction in vocabulary and 
compre! ension skills. 

The effects of the variable courses of in- 
struction were measured in terms of the 
changes that would normally be expected from 
training with tachistoscopic devices. The 
Ophthalmograph was selected as the means 
by which certain of the visual skills might be 
measured quantitatively. Each student was 
tested with the Ophthalmograph prior to in- 
struction and at the conclusion of the training 
period. The film records of the eye move- 
ments were utilized in determining: (a) the 
mean number of fixations; (b) the mean num- 
ber of regressions, (c) the mean span of recog- 
nition; and (d) the mean duration of fixations. 

In addition to the changes in visual skills, 
changes in reading rate have also been at- 
tributed to tachistoscopic training. As an 
index of reading rate, the Silent Reading Check 
RRRP G8-5 was administered prior to in- 
struction and the Silent Reading Check RRRP 


‘ The author wishes to express his gratitude to Colonel 
C. W. Shelburne, Director, and Lt. Col. E. B. Watson, 
Director of Instruction, Marine Corps Supply Schools, 
whose interest and efforts made this project possible. 
In conformance with existing Naval Regulations, the 
opinions or assertions contained in this article are the 
private ones of the writer and are not to be construed 
as official or reflecting views of the Navy Department 
or naval service at large. 


G8-6 was used at the conclusion of the pro- 
gram. The data were limited to reading rate 
since it was felt that this would be a more ap- 
propriate index since tachistoscopes are more 
related to the perceptual skills rather than 
those in comprehension. 

Population. The population to be studied 
was a group of Marine Corps officers under in- 
struction at the Marine Corps Supply Schools. 
The group of 34 officers included 1 captain, 8 
first lieutenants, 24 second lieutenants, and 1 
commissioned warrant officer. 

The officers were divided into an Experi- 
mental and a Control group on the basis of: 
(a) age, (b) raw scores on the Otis Self Ad- 


Table 1 


Comparison of Experimental and Control Groups 


Experimental Control 
Group 

Variables Mean 

Age 25.1 

Otis Test 56.2 

Rate (words per minute) 351.8 

84.1 


14.7 


Comprehension (per cent) 
Education in Years 


ministering Tests of Mental Ability, Higher 
Examination: Form B for High Scheols and 
Colleges; (c) initial reading rate as determined 
from Silent Reading Check RRRP G8-5; (d) 
comprehension scores on above test; and /e) 
the mean educational level in terms of yea’s of 
school completed. Table 1 shows the mean 
scores for each group. 

In addition to these factors, others such as 
the number of regular and reserve officers, 
years of service, active and inactive, were 
also considered and equated. 


Program of Instruction 


Total Group. The group received an hour 
of orientation which included a statement of 
objectives and procedures as well as familiari- 
zation with the various routine functions. 
There were two hours devoted to testing pre- 
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viously described; i.e., visual, reading, and 
intelligence. At the conclusion of the course, 
an hour of critique was held for a final sum- 
mary of progress. 

Reading Rate Controller. This device was 
used by both the Experimental and Control 
groups. Each group spent eighteen 25-minute 
training sessions on the Reading Rate Con- 
troller. 

Control Group. This group followed the 
normal course of instruction which included 
the Reading Rate Controller training de- 
scribed above. In addition, there were eigh- 
teen 12}-minute training sessions with the 
tachistoscope. This training provided prac- 
tice at 5, 6, 7, 8, and 9 digits at 1/25 and 
1/100 of a second. Progression to the next 
higher series of digits was controlled by success- 
ful completion at each speed setting. Suc- 
cessful completion was interpreted to be 23 
correct from a group of 25 slides. The limits 
for competency were those adopted during 
the research phase of the reading program 
sponsored by the U.S. Navy Field Medical 
Research Laboratory. In addition to the in- 
struction and practice on the devices, there 
were nine 12}-minute periods devoted to the 
development of vocabulary and an equal 
number for the development of comprehen- 
sion skills. During the vocabulary periods, 
there was instructioa presented in independent 
word attack skills and dictionary skills. 
Vocabulary checks were administered at each 
session which served to introduce new skills as 
well as to provide practice. In the alternate 
sessions, emphasis was placed upon the de- 
velopment of comprehension skills. The stu- 
dent was provided the opportunity to practice 
in a free reading situation those skills being 
forced by the controlled reading training 
periods. Comprehension exercises were pro- 
vided and served as the check valve for the 
tendency to overemphasize speed in reading. 

Experimental Group. The training received 
by this group differed in that no tachistoscope 
was provided. The time normally allocated 
to this training was included in a broader 
program of training in vocabulary and compre- 
hension skills. 


Results 


The results presented are those dealing with 
the differences that existed between the Experi- 


Table 2 


Summary of Mean Reading Rates in Words per Minute 


Diff. sa—xm t 


458.0 40.5 11.314* 
219.4 34.1 6.435* 


Initial Final 
Experimental 351.8 809.8 
Control 352.4 
Diff. 0.6 
S2i—I2 5.8 


t 0.1 


571.8 

238.0 

56.9 
4.184* 


* Significant at the 1% level. 


mental and Control groups in the area pre- 
viously discussed. The results with the ex- 
ception of reading rate shall be based upon 
the quantitative measurements made from the 
Ophthalmograph film records. 

Reading Rate. The changes that occurred 
during the training period are shown in Table 2. 

The data fail to indicate any significant 
difference between the groups prior to in- 
struction. At the end of the training period, 
a statistically significant difference between 
the groups does appear. It will also be noted 
that both groups made significant gains in 
reading rate as is indicated by their initial and 
final reading levels. In considering the total 
group, the Initial Reading Rate was 352.1 and 
the Final Reading Rate 690.8. The 
difference of 338.7 and the standard error of 
33.3 resulted in a “?’’ of 10.165 which is sig- 
nificant at the 1 per cent level. 

Number of Fixations. In Table 3 there is a 
comparison made of the mean number of 
fixations for each group during the reading of 
a 100-word passage. 


was 


There are no significant differences between 
the groups indicated either prior to or follow- 
ing the training program. 
tically significant 


There are statis- 
differences found within 


Table 3 


Summary of Mean Number of Fixations for 
100-Word Passage 


Initial Final Diff. sxa—z t 


Experimental 6.987* 
Control 
Diff. 
Szi—-Z2 


t 


25.4 3.6 
21.5 4.8 4.476* 


* Significant at the 1% level. 
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Table 4 


Summary of Mean Number of Regressions for 
100-Word Passage 


Diff. Sri— 22 t 


Initial Final 
3.439* 


1.515 


Experimental 11.8 5 6.6 1.9 
Control 8.3 4.2 2.8 
Diff. 3.4 

Sri—7r 3.1 

t 1.116 


* Significant at 1% level. 


each group between the initial and final means. 
As a total group, the mean number of fixations 
were reduced from 76.9 to 53.5. The “‘t’” value 
of 7.855 is significant at the 1 per cent level. 

Vumber of Regressions. Since the reduction 
of the number of regressions would be another 
expected outcome of visual training, the mean 
number of regressions was computed for each 
group from Ophthalmograph records. 
are shown in Table 4. 

There are no indications of significant differ- 
ences with the exception of those found within 
the Experimental group. As a total group, 
the mean was reduced from 10.1 to 4.7. The 
“t” value for the difference was 3.220 which is 
significant at the 1 per cent level. 

Average Span of Recognition. This measure 
is directly related to the number of fixations 
since it is computed from them. It is pre- 
sented as additional information in Table 5. 

There are no indications of significant differ- 
ences between the groups either prior to or 
following instruction. There are significant 
differences noted within each group. As a 
total group, the mean was increased from 1.37 
words to 1.97 words. The “‘t” value of 9.071 
is significant at the 1 per cent level. 

Average Duration of Fixations. 


These 


This meas- 


Table 5 
Summary of Mean Spans of Recognition in 
Number of Words 


Final Diff. sn-—2» 


2.04 
1.90 
0.14 
0.13 
1.085 


Initial 
Experimental 1.37 
Control 1.37 
Diff. 0.01 
sm—Z7 0.08 
t 0.069 


0.08 


0.53 


0.09 
0.10 





* Significant at the 1% level. 


Table 6 


Summary of Average Duration of Fixations in Seconds 


Initial Final Diff. sa—zx t 
0.20 
0.19 
0.01 
0.01 
t 1.539 


0.19 
0.20 
0.01 
0.01 
0.641 


Experimental 0.01 


0.01 


0.01 
0.01 


0.737 
Control 1.594 
Diff. 


Sx 7 


ure is derived from the number of fixations and 
the reading time for the 100-word passage. 
The data are shown in Table 6. 

The data present no basis for assuming any 
differences between the groups or within each 
group as a result of training. The total group 
initially had a mean of 0.19 second, and a final 
of 0.20. The difference was not significant, 
but the means indicate that there is agreement 
with the general acceptance of the average 
duration of fixations. 


Summary 


In comparing the results of the Experimental 
and Control groups, there were no significant 
differences between the groups in the reduction 
of the number of fixations, the increase of the 
span of recognition, the reduction of regressive 
movements, or reduction of the duration of 
fixations. There was a significant difference 
in reading rate at the conclusion of the train- 
ing program, but this was in favor of the 
Experimental group. Significant increases 
were observed within the groups upon com- 
paring the initial and final performances in the 
area of number of fixations, span of recogni- 
tion, and reading rate. 

1. In the adult population studied, the 
results failed to indicate that the Experi- 
mental group was penalized through a lack of 
tachistoscopic training. 

2. Although the areas measured were those 
in which tachistoscopic training is expected 
to produce positive results, the data failed 
to provide any basis for rejecting the null 
hypothesis. 

3. Improvement of the visual skills meas- 
ured by the Ophthalmograph may be the resu/t 
of the improvement in reading efficiency rather 
than contributing to this improvement in 
reading. 
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The Effect of Fluorescent Flicker on Visual Efficiency 


Attilio Zaccaria, Jr., and M. E. Bitterman 


University of Texas 


Although fluorescent lighting has come into 
increasingly widespread use, there is still con- 
siderable doubt about its suitability. Reports 
of strain and discomfort from workers and 
students required to perform visual tasks 
under fluorescent lighting are numerous (6, 12), 
but the source*of these difficulties has yet to 
be established. As Luckiesh (8) noted, it is 
necessary to distinguish between the quality 
of light and the quality of lighting. Luckiesh 
himself believes that complaints about fluo- 
rescent lighting may be traced to inadequate 
control of glare, an opinion in which Hardy (4) 
concurs, and the well-known resistance of the 
public to technological change may play some 
The possibility remains, however, that 
intrinsic properties of the new source—par- 
ticularly spectral characteristics and flicker 
may be responsible in part for the reported 
difficulties. Questions relating to ultraviolet 
output, lag of emission in the yellow-green 
regions, and the significance of spectral lines 
have been widely discussed, but no generally 
acceptable conclusions have been reached (12, 
10, 7,5). Flicker is generally recognized to be 
undesirable, but many writers have mini- 
mized the importance. of this factor in 60-cycle 
installations (12, 2). 

There has been surprisingly little direct 
study of visual functioning under fluorescent 
illumination. 
no significant difference in frequency of blink- 
ing during work under tungsten-filament and 
fluorescent daylight lamps and concluded that 
ease-of-seeing was the same under the two 
conditions. Unfortunately, however, the un- 
reliability of the index employed and its lack 
of relation to effort-expenditure in visual work 
casts doubt upon the validity of this con- 
clusion (20). Preference tests conducted by 
Holway and Jameson (6) gave a clear advan- 
tage to tungsten as compared with a variety 
of differently colored fluorescent sources, but 
the validity of preference tests cannot be 
taken at face value. Dark-adaptation was 
found to be retarded by work under fluo- 


role. 


Luckiesh and Moss (9) found , 


rescent as compared with incandescent light, 
but the difference disappeared when indirect 
lighting was used. In a study with the 
American Optical Company’s Sight-Screener, 
Gray and Prevetta (3) recorded changes in a 
variety of visual functions following two hours 
of reading under equally bright (20 
candle) fluorescent lighting and daylight. 
No significant difference between the two con- 


foot- 


ditions was found, but the possibility remains 
that differences might have been revealed by 
other measures. 

If research on visual functioning under tluo- 
rescent light has not been abundant, neither 
has it been sufficiently analytical; no attempt 
has been .made to separate the two principal 
factors—spectral characteristics and flicker 
which differentiate fluorescent other 
sources. In the experiment here reported, 
which was designed™to study the effects of 
flicker, that factor was isolated by comparing 


from 


\.C.- and D.C.-operated fluorescent lamps.' 
Furthermore, there has been no attempt in 
previous investigations to that the 
amount of visual work done by the subjects 
under the conditions studied was the same, a 
difficulty which was remedied in the present 
study by the use of a visual task that provided 
an objective measure of performance. Finally, 
insufficient attention has been given to the 
selection of appropriate indices of fatigue and 
efficiency. This problem is the most crucial 
of all in contemporary research on illumination 
1); performance measures are inadequate in- 
dices of fatigue and efficiency, and techniques 
for the evaluation of effort are still in a develop 
mental stage (13, 19). In the present study, 
primary concern with the effects of fluo- 
rescent lamp flicker led to the use of CFF 
critical fusion frequency) as an index of 
fatigue. There is some evidence that CFF is 
reduced by exposure to flickering light (18, 
11), and a variety of studies by Simonson and 


insure 


‘In order to study the effects of spectral quality 
independently of flicker, all sources should be D.C 
operated 
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Table 1 


Design of Experiment 
Test Form Illumination 


Period 1 Period 2 


Period 1 Period 2 


Group 
1 I II A.C. 
2 I II DX. 
3 II I AA. Dx. 
+ II I D.C. A.C. 


D.C. 
A.C. 


his colleagues (14, 15, 16, 17) suggest that a 
decline in CFF may be employed as a valid 
index of impairment. 


Apparatus and Procedure 

The visual tasks selected for the experiments 
were Forms I and IT of Tinker’s Speed of Read- 
ing Test”. This test consists of a series of 
numbered sentences, each of which contains a 
word which spoils the meaning of the sentence, 
and the task of the S is to locate and cross out 
these words. The sentences are simple enough 
to minimize the comprehension factor when the 
test is used with college students. The 
number of items correctly marked in a given 
period provides an objective measure of 
achievement. 

Twenty students at the University of Texas, 
12 males and 8 females, served in the experi- 
ment. Their vision was normal or corrected 
to normal. Each S took both forms of the 
test, 30 minutes being allowed for each form. 
Half the Ss began with Form I and half with 
Form II. Each S worked under both con- 
ditions of illumination, half béginning with 
A.C. and half with D.C. The procedure, 
therefore, required four subgroups, as shown 
in Table 1. 

The Ss were studied individually in a 
specially constructed, semicircular enclosure, 
6 feet high and 41 inches wide, which contained 
a writing surface. The entire surround was 
painted flat white. Three 15-watt General 
Electric daylight fluorescent lamps were 
mounted on the ceiling of the booth, well out 
of S’s visual field. The power-supply made 
it possible to operate the lamps, which were 

? We are indebted to Dr. Miles A. Tinker for providing 
these materials. 


wired in series, on either A.C. or D.C. The 
transition from alternating to direct current, 
and the reverse, were accomplished by the 
operation of a double-pole-single-throw switch. 
The level of illumination on the working sur- 
face was 20 foot-candles under each condition. 
A circular opening, 5/8 inches in diameter, was 
cut in the surround at eye-level. The opening, 
covered with a milk-glass plate, was 15 inches 
away from S, and behind it a General Radio 
Strobotac, Type 613-B, was set. With this 
apparatus the CFF determinations were made. 

S was uninstructed as to the purpose of the 
experiment. He was told that his speed of 
reading was being measured and he was 
asked to work as rapidly and as accurately as 
possible. For each S, fifteen CFF determina- 
tions (ascending order) were made in all—five 
before the reading began, five at the con- 
clusion of the first reading period, and five at 
at the end of the second period. 


Results and Discussion 


Table 2 shows the mean performance scores 
and CFF drops under the two conditions of 
illumination. The difference in performance 
was not statistically significant (¢ = .7, P> 
05). The drop in CFF under the D.C. con- 
dition was not significant (¢ = .75, P > .05), 
but the A.C. drop was hightly significant 
(t= 5.0, P < .01). The difference between 
the two conditions in terms of CFF drop also 
was Statistically significant (¢ = 2.9, P < .01). 
Changes in CFF for Groups 1 and 3 and Groups 
2 and 4 combined are plotted in Fig.1. 

A more thorough examination of the re- 
lationships revealed in the data was made in 
an analysis of variance. The principal pur- 
pose of this analysis was to test the signifi- 


Table 2 


Speed of Reading and CFF Drop asa 
Function of Illumination 


S.E. 
Ax. D.C. Diff. Diff. N 
Reading Score 272.8 2704 24 34 20 
CFF Drop 1.25 25 20 
51 .68 20 

ae 
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CRITICAL FUSION FREQUENCY 





TEST 
Fic. 1. CFF drop as a function of illumination. 
cance of the order effect suggested in the curves 
of Fig.1, but this effect did not prove to be 
significant (F = 1.1, P > .05). Analysis of 
variance confirmed the conclusions based on 
t-tests. CFF drop was significantly influenced 


by condition of illumination, but speed of 


reading was not. 

At the conclusion of the experimental ses- 
sion, each S was asked whether he had noticed 
a difference in the illumination employed in 
the two periods of work. Of the 20 Ss, only 
five noted a difference, but all five, without 
exception, reported a preference for D.C. 
condition, which came first for two of them 
and second for the remaining three. These 
reports, therefore, tend to confirm the ob- 
jective findings of the experiment. 

These results suggest the undesirability of 
single-lamp A.C.-operated fluorescent fixtures 
which are widely used in the home, if not in 
commercial installations. The present ex- 
periment permits no conclusion with respect 
to the adequacy of two-lamp, out-of-phase 
installations such as are commonly used in 
factories and schools, but these fixtures could 
be studied by the technique here employed. 
This experiment provides no basis for evalu- 
ating the spectral properties of fluorescent 
sources, although again it suggests the kind 
of work which might be done. In order to 
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control the flicker factor, D.C.-operated fluo- 
rescent lamps should be used for comparisons 
with other sources. 


Summary and Conclusions 


The experiment here reported was designed 
to study the effects of fluorescent lamp flicker 
upon visual fatigue. Performance of a stand- 
ardized visual task was measured for two 30- 
minute periods under 20 foot-candles of fluo- 
rescent daylight illumination. During one of 
the periods the lamps were operated with 
direct current, while during the other period 
they were operated with alternating current. 
In this way spectral characteristics, brightness 
level, and distribution were constant, with 
flicker being the only variable. Performance 
did not differ significantly under the two 
conditions, but the A.C. condition produced a 
significantly greater drop in critical fusion 
frequency than did the D.C. Only 25 per 
cent of the subjects detected a difference be- 
tween the two conditions of illumination, but 
those that did uniformly expressed a prefer- 
ence for the D.C. condition. 

It may be concluded that single-lamp, or 
in-phase, multiple-lamp fluorescent installa- 
tions are undersirable. Further experimenta- 
tion is needed for the evaluation of out-of- 
phase installations. 


Received December 24, 1951. 
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Visual Tracking: II. Effects of Brightness and Width of Target! 


Robert S. Lincoln and Karl U. Smith 


University of Wisconsin 


The problem of the role of sensory cues in 
defining accuracy in visual tracking has both 
theoretical and applied significance. Ele- 
mentary notions suggest that precision in 
tracking would correspond directly to the 
perceptual cue refinement resulting from size, 
brightness and velocity variations in the 
sensory situation. But visual tracking is not 
a simple, direct response to sensory cues. 
Rather, it is a response pattern composed of 
simultaneous adjustive reactions of position, 
rate, and acceleration control. Furthermore, 
the human operator in the tracking task acts 
as an oscillating generator, whose accuracy 
of response is only partly defined by the 
perceptual aspects of the tracking situation. 
The tracker’s precision, therefore, may not be 
directly related to the magnitudes of stimula- 
tion produced by the: sensory characteristics 
of the target and of the cursor. 

In regard to these special considerations 
an attempt has been 
made to determine in fact how tracking ac- 
curacy varies with brightness of target area, 


about visual tracking, 


width of target, and with changes in the pattern ' 


of the target and cursor. 


Experimental Methods 


1. Design. In this report we describe a 
series of experiments, all dealing primarily with 
the effect of changes in target width upon the 
accuracy of tracking. Three experiments have 
been performed in order to determine the 
nature of this target-width effect relative to 
variation in target brightness and target-cursor 
pattern. 

The first experiment utilized a design in 
which four subject groups were trained and 
tested on different target-cursor patterns com- 
bined with targets of different width. The 
subject groups were all tested over the same 
range of variation in target brightness. 

In the second experiment, the effect of varia- 
tion in target width upon the accuracy of 


This research was supported by funds provided by 
the Legislature of the State of Wisconsin and assigned 
by the Research Committee of the Graduate School, 
University of Wisconsin. ‘ 
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tracking was studied with a target and cursor 
of fixed pattern and fixed brightness. This 
experiment was conducted in order to deter- 
mine the character of target-width effects with 
a greater variation in the width of the target. 
The study involved a Latin square design in 
which all subjects were tested under all experi- 
mental conditions. 

The third experiment dealt with target-width 
effects in tracking when cursors of different 
colors were used in combination with a number 
of target widths. This experiment also utilized 
a Latin square type of design in which all 
subjects were tested under all experimental 
conditions. 

The specific conditions of these experiments 
and other pertinent details connected with the 
statistical aspects of design will be mentioned 
in connection with the presentation of the 
results. 

2. Apparatus. The detailed features of the 
apparatus used in these experiments have been 
described previously.22 The subject’s task is 
to track a small target rotating at varying 
speeds. ' The target moves in both a clockwise 
and counterclockwise direction through a limit- 
ing arc of some 300 degrees. Its radius of 
rotation is approximately nine inches. A cam 
arrangement regulates the direction and veloc- 
ity of target movement. The subject controls 
a handwheel, 18.4 cm. in diameter, located 
approximately 130 cm. from the target plane. 
This handwheel in turn controls a cursor of the 
same radial length as the radius of rotation of 
the target. Cursor and target approximate 
the same plane of movement in order that 
parallax effects may be eliminated. 

Target-cursor pattern is varied by sliding the 
cursor up or down so that either an overlapping 
or vernier pattern can be secured. Variations 
in target width are effected by means of a slide 
arrangement on the target support. 

The error-recording system utilized in the 
present apparatus produces an integrated error 
record that is registered on a clock. Such a 
system weights the subject's errors according 
to the magnitude of the error and, therefore, 
includes more information in the final trial 
score than would a system which records only 
‘on target”’ time * The error recording adjust 
ment of the apparatus was kept constant for 
all target widths. Accordingly, the intrinsic 


2 Lincoln, R.S., and Smith, K. U. Transfer of train- 
ing in tracking performance at different target speeds 
J. Appl. Psychol., 1951, 35, 358-362. 
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difficulty of the tracking task remained at a 
fixed level, regardless of target width. 

The mechanism of the integrated error re- 
cording system consists of a hollow brass tube 
that is rotated at a constant speed by a motor. 
A triangular piece is cut from the surface of 
the tube and the tube is filled with sealing wax. 
A mechanical indicator makes continuous con- 
tact with the surface of the tube and the inter- 
mittent electrical contact between the indicator 
and the rotating brass plate of the tube regis- 
ters magnitude of error in accordance with the 
deviations of the indicator from a zero position. 
This time of contact between the indicator and 
and the tube plate is registered on the clock. 

Illumination of the target area is provided 
by a slide projector that is mounted on a 
tripod and enclosed except for the emerging 
light beam. Variation in the brightness of the 
target area is produced by a series of Wratten 
filters.® 


Results 


Experiment 1. Effects of Variation in Target 
Width, Target-Cursor Pattern, and Target 
Brightness. In this experiment two target 
widths were used. The width of one target 
subtended a visual angle of 42 minutes while 
the visual angle subtended by the second 
measured only 4 minutes. The targets were 
60 minutes high. The cursor used was 4 
minutes wide and 60 minutes long. Target- 
cursor pattern was varied in two ways. In 
one pattern the cursor completely overlapped 
the target, while, in the second, the cursor and 
target were arranged in a vernier relationship. 
Both target widths were used with both types 
of cursor, making up four separate target- 
cursor combinations. Target brightness was 
varied over four levels which covered a range 
of three log units. 

Twenty-four students, both male and fe- 
male, served as subjects in this experiment. 
The instructions to the subject were: “‘Try to 
keep the cursor in the center of the target at 
all times.” These instructions were constant 
in all experiments. 

On the first day of the experiment all sub- 
jects received four two-minute trials. Each 
trial involved a different target-cursor com- 
bination. The orders in which the different 
combinations were presented to the 24 sub- 
jects were assigned at random from the total 


of 24 possible orders. On the second day of 


3’ Eastman Kodak Company, Rochester, New York. 
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the experiment all subjects again received four 
two-minute trials involving the four target- 
cursor combinations, but in a randomly as- 
signed order which differed from that of the 
previous day. The mean scores obtained on 
these first eight trials served as a basis for 
matching the subjects in four groups of six 
subjects each. 7 

On each of the remaining experimental days 
all of the groups tracked for three two-minute 
trials per day under one of the levels of target 
brightness. At the end of the experiment, all 
four groups had tracked under all four levels 
of brightness. The orders in which the sub- 
jects received the different brightness levels 
were also assigned at random so that each sub- 
ject received a different one of the 24 possible 
orders. Six minutes of dark adaptation were 
required of all subjects before the first trial 
was begun on each of the last four days.  Fol- 
lowing the completion of this phase of the ex- 
periment, kymograph records were obtained 
of the adjustments made by some of the sub- 
jects in tracking the narrow and wide targets. 

The accuracy scores obtained indicated that 
the wide target was superior to the narrow 
target when all other conditions were con- 
sidered together. Generally, the vernier cur- 
sor was superior to the overlapping cursor. 
Finally, tracking accuracy was observed to be 
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Fic. 1. Mean accuracy scores made with different 
cursor types and with different target widths. 
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directly related to the level of target bright- 
ness. An analysis of variance performed on 
these data showed differences between the 
levels of these variables to be significant below 
the .1% point.* 

Additional information concerning the re- 
lationship between target width and tracking 
accuracy is pictured in Figure 1. This figure 
shows that the accuracy of tracking the wide 
target was greater than the accuracy obtained 
with the narrow target only when the cursor 
was in the overlapping position. When the 
cursor was in the vernier position, little differ- 
ence appeared between the targets. This 
interaction was significant below the .1% 
point. 

Further evidence of the complicated nature 
of the relationships existing between the 
variables studied in this experiment is shown 
in Figure 2. The interaction represented by 
this figure was also significant below the .1% 
point. The figure portrays the same re- 
lationship depicted in Figure 1, but in addition 
indicates that even these relationships vary 
with the level of target brightness. At the 
higher brightness levels the wide-target over- 
lapping-indicator combination seems to be 
superior to all others. However, ‘“‘?’ tests 
show that this target indicator combination is 
significantly superior to the narrow-target 
vernier-indicator combination only at the 
brightness level of log 0.37 millilamberts. At 
the lower brightness levels, the vernier indica- 
tor was superior regardless of target width. 
As the figure also indicates, the lowest accuracy 
scores were made throughout the entire range 
of target brightness when a narrow target was 
combined with an _ overlapping indicator. 
Similar results appear in an examination of 
the kymograph records obtained at the end of 
this experiment. 

Experiment 2. The Effects of a Wide Range 
of Target Widths, and Variation in Cursor 
Color. In this experiment six target widths 
were used. The targets were white and sub- 
tended visual angles of 4, 30, 56, 82, 108, and 
134 minutes. Their height subtended a visual 


angle of 58 minutes. The cursor, which was 


‘ The critical summaries of data as well as the analysis 
of variance tables have been deposited with the Ameri- 
can Documentation Institute. 
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Fic. 2. The variation in tracking accuracy 
function of level of illumination of the target-cursor 
pattern for an overlapping pattern (open figures) and 
for a vernier pattern (solid figures) and with different 
widths of target. 
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kept in the overlapping position, had an 
angular width of 4 minutes and a length of 60 
minutes. In this experiment, it was painted 
a flat red. A high level of target brightness 
was maintained throughout the experiment. 

Subjects were assigned to the rows of three 
randomly drawn 6 X 6 Latin squares, in which 
the columns represented trials and the treat- 
ments were the six target widths. The 18 
subjects were students who appeared on two 
separate days with a one-day interval between 
appearances. On the first day, all subjects 
tracked each of the targets for two minutes. 
On the second day, this pattern was repeated. 
At the end of the second day’s trials all sub- 
jects ran one trial on the 4-minute target and 
one trial on the 30-minute target, this time 
using a white cursor. The order in which 
these targets were tracked counter- 
balanced between subjects. 

Analysis of the difference in scores made 
with the 4- and 30-minute targets combined 
with the white cursor again showed that ac- 
curacy was greater with the wide target than 
with the narrow target. A “‘t’’ test indicated 
that this difference was significant below the 
5% level. 


was 


Relative to the mean score made 
with the narrow target, this difference repre- 
sents a 2.8 per cent increase in accuracy. 
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The scores made with the red cursor showed 
no increase in accuracy for the 30-minute 
target as compared to the 4-minute target. 
Actually, the mean scores made in this situa- 
tion were identical to the nearest one-tenth 
second for these two target widths. Of equal 
interest is the fact that over a range of target 
widths in which the widest target was over 30 
times as'’wide as the narrowest, the accuracy 
of tracking decreased only 3.5 per cent. This, 
too, is a significant difference, but it is one of a 
surprisingly small magnitude considering the 
extent of the variation in target width. 

Experiment 3. Retest of the Effects of Target 
Width and Variation of Cursor Color. In the 
second experiment, the color of the cursor was 
observed to have some effect on accuracy when 
only two target widths were used with both 
cursor colors. The third experiment was 
conducted to test the color effect over a 
greater range of target widths. 

Five targets having angular widths of 6, 18, 
30, 42, and 54 minutes were used. These 
targets were painted a flat white and were 58 
minutes high. Two overlapping cursors were 
used with these targets. Both cursors sub- 
tended visual angles of 6 minutes in width and 
were 66 minutes long. One was painted a flat 
white, while the second was painted a flat red. 
In the experiment, each cursor was combined 
with each of the five targets, making a tétal of 
10 experimental conditions. Target bright- 
ness was maintained at a high level through- 
out the experiment. 

As subjects, twenty students were assigned 
to the rows of two randomly drawn 10 X 10 
Latin squares. All subjects appeared for five 
consecutive days, and on each day tracked for 
one minute with each of the 10 target-cursor 
combinations in an order indicated by the 
Latin square design. Scores from only the 
last three days were used in the determination 
of the results, because it was desired to test the 


critical effects on well-trained subjects. 
The results with the red cursor confirmed 


Experiment 2 in showing that no optimum 
target width appeared. For this more re- 
stricted range of target widths, in which the 
ratio of the widths of the narrowest and widest 
target was 1/9, an accuracy decrease of only 
0.9 per cent was observed. 
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With the white cursor there appeared a 
relative decrease in accuracy scores of 0.4 per 
cent when the widest target was compared to the 
narrowest. In addition, slightly higher scores 
were made with targets of angular widths, of 
18, 30 and 42 minutes than with the narrowest 
target, although these differences did not meet 
the 5% criterion of significance. 

When all targets were considered together, 
there appeared to be little difference between 
the mean scores made with the red and white 
cursors. 

Summary 

The present study, comprising three experi- 
ments, has disclosed certain significant facts 
about the psychophysical determination of 
error in direct tracking of a target. 

It has been found that the pattern relations 
of target and cursor are related to accuracy of 
visual tracking. A vernier relation of target 
and cursor generally produces more accurate 
performance than an overlapping pattern of 
target and cursor when the color of the two 
elements of the visual presentation is the 
same. 

Illumination level of target and cursor 
affects accuracy in tracking. At low illumi- 
nations, accuracy drops off decisively for a 
cursor pattern which overlaps the target. 
Generally, the effects of change in illumination 
in relation to variations in the pattern of 
target and cursor, as well as alterations in the 
width of the target, are marked by complex 
interactions which make it difficult to formu- 
late simple rules regarding these relations. 

By far the most significant result of this 
study is the observation that an increase in 
the width of the target produces no marked 
change in the level of tracking accuracy. 
Targets some thirty times the width of the 
controlled cursor are tracked with almost the 
same accuracy as targets equal to the width of 
the cursor. In fact, under some conditions, 
maximum levels of accuracy are found with 
targets of a width greater than the width of 
the cursor. These results are secured under 
conditions in which the criterion of error re- 
mains fixed for all target widths. 

The findings just noted have direct applica- 
tion for the design of the perceptual presenta- 
tion in tracking devices as well as theoretical 
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implications for understanding tracking be- 
havior. 

The target-width effect, as observed here, 
suggests that the psychophysical laws of track- 
ing behavior deal mainly with phenomena of 
organization of visual pattern rather than 
tolerances of alignment and misalignment of 
visual contours. The tracker’s accuracy is 
determined by precision in scaling or bisection 
of the visual pattern rather than in terms of 
the optical resolution of limiting contours that 
define the visual presentation. 

It may be that the target-width effect is a 
direct product of the character of the tracking 
response. of the 


The continued oscillation 


tracker about the target restricts visual judg- 
ment to a sustained estimate of relative sym- 
metry of target and cursor position. 


In this 


421 


sense, the present study constitutes a demon- 
stration that the psychophysical aspects of 
tracking behavior reflect the special charac- 
teristics of variable error control that identifies 
the nature of the tracker’s response. 

This interpretation of the psychophysical 
organization of tracking implies that any cue 
aspect of the tracking situation which does not 
alter the critical oscillatory features of re- 
sponse will not change materially the level of 
accuracy in the situation. Such a systematic 
notion of tracking seems to give a reasonable 
account of some of the other special aspects of 
tracking, especially the phenomena of learning, 
the effects of change in speed of target, and the 
effects of transfer of training in relation to 
target speed.” 


Received January 8, 1952. 








Comment on Darley’s ‘“‘Special Review” 


Kenneth Eells 


U.S. Naval Personnel Research Unit, San Diego, California* 


In the April, 1952, issue of J. appl. Psychol., 
appeared a “Special Review” of a_ book, 
Intelligence and Cultural Differences of which 
I was a major contributing author. It is not 
clear exactly why this particular book was 
singled out for this flattering “‘special” rather 
than routine reviewing. A search of the back 
files of the Journal reveals only two other such 
instances in the past five years. 

Since the book deals with a large-scale re- 
search study in an important (and contro- 
versial) area, three possibilities immediately 
come to mind: (1) The book possesses unusual 
merit and therefore is worthy of a special effort 
to bring it to the attention of the Journal 
readers; (2) the book is so extremely bad that 
it should be pointed out as a horrible example; 
or (3) the book deals with a controversial area 
and therefore will be of special interest to the 
Journal readers. 

The first of these possibilities can be dis- 
missed quickly, in view of the strongly deroga- 
tory nature of the review. While the writer is 
not in a position to pass an objective judgment 
with respect to the second possibility, it does 
seem odd, if this is what prompted the special 
attention, that the Program Committee of 
Division 5 of the APA selected this particular 
book, and the research which it reports, as the 
subject for a symposium at the recent Wash- 
ington meeting. If the third reason is the 
correct one, the Editor of the Journal is pre- 
sumably at fault in having a controversial 
book reviewed by an avowed opponent of the 
point of view expressed in the book without 
making provision for presentation of other 
points of view. 

It might be, of course, that the pages of an 
APA journal were simply used to present a 
one-sided review of a controversial book and 
that the review was played up by the Editor 
as a “Special Review” to add prestige to the 

* The opinions expressed are solely those of the author 
and are in no way official; nor are they to be construed 


as representing those of the U. S. Naval Personnel 
Research Unit or Bureau of Personnel. 


attack contained in the review. But one 
would come reluctantly to any such conclusion. 
APA journals have had, for the most part, a 
long and honorable history of fair play and 
scientific objectivity of which they can be 
proud. 

Darley charges the authors of the book with 
lack of dispassionateness and objectivity, 
special pleading, unwarranted assumptions, 
confusion of hypotheses with conclusions, un- 
satisfactor,, sampling procedures, faulty in- 
terpretation of correlations, improper selection 
of items for study, a research design so planned 
as to maximize the chances of proving the 
hypotheses, inconclusiveness of findings, and 
failure to perform certain possible analyses of 
the data. Not a single significant favorable 
comment is found in the entire review, although 
the book appeared under the joint authorship 
of five individuals connected with reputable 
institutions and was published by a reputable 
university press. 

Probably the most serious charges which 
Darley makes, because they attack the 
scientific integrity of the authors, are those 
dealing with confusion of hypotheses with 
conclusions, unwarranted assumptions, and a 
research design so planned as to maximize the 
chances of proving the hypotheses. One 
would expect anyone making such charges to 
be scrupulously careful to be accurate and to 
document such statements in detail. Darley 
fails in both respects. 

Space forbid* an adequate discussion of 
these points but a few general observations can, 
and should, be made. The writer wishes first, 
however, to apologize for the too-general 
nature of the comments which follow, and for 
his failure to document his statements more 
fully or to develop them to the point where 
the reader could make an intelligent judgment 
about the matters himself. He prepared such 
a statement, taking up each of Darley’s 
charges and citing quotations from the book 
in each case to show that Darley had either 
read carelessly er had misinterpreted what he 
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had read, had misunderstood the basic nature 
of the research, was being impossibly per- 
fectionist in his expectations, and in one case 
had “slanted” his review by selective citation. 
All this was spelled out with quotations and 
page references to document it fully. The 
Editor ruled that this statement was too long. 

An abbreviated form was then submitted, 
which would have required four journal pages. 
This too was refused publication, even when 
the writer offered to pay the regular page rate 
for adding new pages to the Journal, as is done 
with ‘early publication” materials. He was 
told ‘‘Either you will provide a reply within 
1200 words (14 pages) or you will have no 
space at all.’ The Editor’s letter openly 
took sides with the reviewer. 

Scientific understanding can sometimes be 
advanced through scholarly controversy, but 
only when such controversy is based upon 
either carefully documented evidence or 
carefully reasoned analysis. Neither is pos- 
sible within the space limitations which ap- 
parently apply to such controversies in J. 
appl. Psychol. This being the case it is 
particularly important that reviewers give 
well-balanced and objective presentations of 
such controversies. 

Darley’s charge that two of the authors were 
lacking in objectivity and ‘‘transmute assump- 
tions and into 
clusions” reveals that he simply did not read, 
or did not understand, Chapter 1 of the book, 
in which the structure of the book was ex- 
plicitly described. The chapters to which 
Darley refers were there clearly described as 
introductory analysis of the issues for the 
purpose of providing insight into the setting 
of the problem. Any interpretation of these 
chapters as conclusions from the research 
study was explicitly warned against. The 


hypotheses foregone con- 
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wisdom of such a presentation may fairly be 
questioned, but to charge that the chapters do 
something which they do not do is something 
else again. 

Space will permit comment on only one of 
the assumptions which Darley refers to: 
“Davis and Havighurst apparently assume 
.. . that 2/eaezethodological questions in the 
study of stratification have been solved.”’ 
This is utter nonsense. No has 
worked in this area could possibly think~that 
all methodological questions have been solved. 
At no point in the book do any of the authors 
say, or imply, any such thing. In no other 
area of research is it customary to imply that 
no research conducted until all 
methodological problems have been com- 
pletely solved. Would Darley like to see all 
research in the field of guidance deferred until 
perfect procedures are developed for measuring 
adjustment of individuals? To such extremes 
does a reviewer go when he substitutes zeal for 
destruction for objectivity. 


one who 


should be 


To charge the authors of a research study 
with having so designed the study as to maxi- 
mize the possibilities of proving their hypothe- 


ses is about as far as one can go in charging lack 
of personal and scientific integrity. Darley’s 
description of what he based this upon reveals 
a complete misunderstanding of the purpose 
Un- 
fortunately, to discuss this important point in 
sufficient detail to make it clear to one who 
probably has neither the book nor the review 
before him would require more space than is 
available. 

The, writer will be glad to supply a mimeo- 
graphed copy of his more extended statement 
to any interested reader. 


of the research study he was reviewing. 


Received August 27, 1952. 
Published out of turn by the editor. 








Reply to Eells’ Comment on Darley’s “Special Review” 


John G. Darley 


Laboratory for Research in Social Relations, University of Minnesota 


The editor of this journal has permitted me 
to make a short rejoinder to the above com- 
ment by Dr. Eells on my earlier review of the 
book of which he was senior author. I doubt 
that this exchange will produce any rap- 
prochement, in view of the complexities and in- 
volvements inherent in research investigations 
of stratification phenomena, but I shall try at 
least to make my position as a reviewer clear. 

A substantial part of Dr. Eells’ comment 
concerns the editorial policies and practices of 
this Journal. Iam obviously not in a position 
to reply to this, nor is it entirely germane to 
the issue as I see it. Iam sure that Dr. Eells’ 
position on my review will be abundantly clear 
to anyone who accepts his offer to receive ‘‘a 
mimeographed copy of his more extended 
statement.” I sincerely hope many psycholo- 
gists take advantage of that offer. 

The burden of his present comment regard- 
ing my review appears to be twofold: (1) I 
made no significant favorable comment in my 
review; and (2) I have criticized him and 
particularly his co-authors not only for the 
design and interpretation of his study but also 
for their interpretations and treatment of the 
general problem toward which his research was 
directed as a specific study. 

I know of no commonly accepted canons’ or 
mores of book reviewing for technical journals 
under which a reviewer is required to make 


favorable comments. I have, rather, operated 


on the philosophy that if a reviewer believes a 
book to be either outstandingly bad or good, he 
is morally obligated to state his carefully con- 
sidered opinions unequivocally. This obliga- 
tion is the greater, to the extent that a book 
deals with a serious or a controversial topic and 
to the extent that great claims are made for 
the book. Psychology should by now be 
somewhat beyond the point in its history as a 
science when it must award many A grades for 
effort only. 

In the last analysis, neither the author nor 
the reviewer represents the final judgment in 
history. Both the author and the reviewer 
express their own best judgments, morally and 
scientifically; present and future readers are 
still free to accept the judgment of one or the 
other, or neither, as they see fit. . 

So far as the second phase of Dr. Eells’ com- 
ment is concerned, he has well summarized my 
objections to his work, and I find no reason to 
change them on the basis of his rebuttal. 
While I have no wish to choose up sides in this 
matter, it interest to that 
McNemar’s recent and independent review of 
book! 
criticisms that seemed to me worth noting, 
and in addition raised a few other objections 
that, regrettably, escaped me. 


was of note 


the same raised some of the same 


1 McNemar, Q. Review of /nielligence and Cultural 


Differences. Psychol. Bull., 1952, 49, 370-71 





Book Reviews 


Dale, Ernest. Planning and developing the 
company organization structure. New York: 
American Management Association. Re- 
search Report Number 20. 1952. Pp. 232. 
$4.50. ($3.00 to AMA members.) 

This book is the result of a two-year re- 
search program sponsored by the American 
Management Association and designed to 
emphasize the realities of organization. The 
research included visits to 40 companies 
of varying sizes; participation in the work of 
changing company organizations; examination 
and analysis of several hundred organization 
manuals and organization charts; a survey of 
American and foreign literature on organization; 
and interviews with many military and indus- 
trial thinkers and practitioners on organization. 

There are two main parts to the book. Part 
One is entitled ‘‘The Dynamics of Organiza- 
tion—A Study of Organization Problems at 
Various Stages of Company Growth” and is 
divided into seven sections referred to as the 
seven stages of company growth—(1) deter- 
mining objectives and dividing work; (2) 
delegating responsibility; (3) span of control; 
(4) the staff assistant; (5) the staff specialist; 
(6) group decision-making; and (7) decentrali- 
zation. Part Two is entitled ‘The Mechanics 
of Organization” and is divided into 11 sections 
under such topics as reorganization; timing, 
defining and constructing the organization; the 
organization chart; the organization manual; 
and gaining acceptance. There are six ap- 
pendices which include job descriptions of 
major executives; descriptions of management 
committees; content and extent of decentrali 
zation of major management functions; the 
summary of contents of an oil company man- 
agement guide; and organization nomenclature 
of a large automobile company. In addition, 
there is an extensive bibliography grouped for 
each section of the book and also separate sec- 
tions covering certain selected topics in organi- 
zation. 

Throughout all of the material the author 
combines what is technical, academic or 
scientific on the subject of organization with 
what he has found to be business practice and 


practical application. In all of the main sec- 


tions and in many of the sub-sections he il- 
lustrates the theoretical material with perti- 
nent cases from specific companies. In some 
instances, however, this process of illustrating 
leads him astray since he uses the specific case 
as illustrative of a general principle. Much 
of the material is illustrated with organization 
charts, although the principles and problems 
of designing and constructing organization 
charts are not given the importance which 
they justify in a book on this subject. 

In his discussion of organization problems 
in Part One, the author stresses the desir- 
ability and the growing use of (1) the staff 
assistant, a person who is not an exeeutive, but 
aids an executive in getting things done with- 
out taking away or relieving the executive of 
any of his responsibilities; and (2) the staff 
specialist or consultant. He emphasizes the 
value of the staff specialist in large organiza- 
tions. However, he fails to point out the very 
pertinent fact that individuals who can be 
employed to perform specific assignments as 
the need for them arises are very valuable to 
small businesses where the quantity of work at 
no time justifies the employment of full-time 
persons for specific occasional duties. In a 
highly practical presentation he includes ex 
cellent discussions of group decision in operat- 
ing organizations along with discussions of 
different types of committees, their functions, 
and ‘the strategic 
mittee work. 

Perhaps the major weakness of the volume 
is that throughout the many pages devoted to 
the concepts of responsibility and authority, 
the author does not define them, nor does he 
make any distinction between them. In fact, 
it appears that he uses the terms interchange- 
ably, and discusses the delegation of responsi 


factors in successfal com 


bility as well as the delegation of authority. 
Since these concepts are important in organi 
zation planning, it would have been helpful 
if the discussions had emphasized that ideally 
the amount of responsibility and authority 


should be equal, that there are important 
differences between them, and that one of the 


outstanding differences is that authority can 
be delegated whereas responsibility cannot. 
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The professional value of this book to psy- 
chologists will be limited largely to those who 
have direct contacts with industry, or who are 
connected with schools of business, or who have 
a specific interest in executive activity and 
organization problems. While the author 
stresses the dynamics and continuity of or- 
ganization planning and the dependence of 
much organizational activity on the personal- 
ities in the organization, his discussions do not 
include any direct references to the theoretical 
psychological principles involved. On the 
other hand, all business executives should be- 
come acquainted with the book. They should 
not read it, however, with the expectation that 
it will solve their organization problems or 
that it will eliminate the necessity of their 
continuing use of expert advice and counsel as 
the problems discussed in the book arise in 
their own business relationships. 


C. G. Browne 
Wayne University 


Von Foerster, Heinz. (Ed.) Cybernetics: circu- 
lar causal and feedback mechanisms in bio- 
logical and social systems. New York: 

Pp. 


Josiah Macy, Jr. Foundation, 1952. 


240. $4.00. 

This is the third volume on cybernetics 
published by the Josiah Macy, Jr. Foundation 
and is a complete transcript of the eighth con- 
ference on this subject sponsored by the 
Foundation. Although the title does not indi- 
cate it, this conference was devoted almost 
entirely to problems of communication. Six 
papers were presented and thoroughly dis- 
cussed by representatives of the natural and 
social particular interest to 
applied psychologists seriously concerned with 
communications might be the following: Com- 
munication Patterns in Problem Solving 
Groups (Bavelas), Communication between 
Men: Meaning of Language (Richards) and 
Communication between Sane and Insane: 
Hypnosis (Kubie). Communication between 
Animals (Birch), Presentation of a Maze- 
Solving Machine (Shannon) and In Search of 
Basic Symbols (MacKay) are somewhat far 
afield, irrelevant or overly technical for the 
reader without a strong general interest in 
communications per se. 


sciences. Of 
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The book is not a collection of answers to 
communication problems or even a report of 
experimentation directed toward that end. It 
is instead a stimulating source of hypotheses 
and suggestions and an interesting illustration 
of the application of widely differing ap- 
proaches to a common problem. The dis- 
cussions are intense and wide-ranging and at 
times seem to get out of hand. The free ex- 
change of ideas, however, seems very valuable 
and is certainly worth the occasional digression. 

Two appendices deal with the nomenclature 
of information theory and references. 

James J. Jenkins 


University of Minnesota 


Janis, Irving L. Air war and emotional stress. 
New York: McGraw-Hill Book Company, 
Inc., 1951. Pp. 257. $5.00. 

On November 3, 1944 President Roosevelt 
directed the War Department to investigate 
systematically the role of air power in war and 
peace. The “human factor” was an integral 
part of that investigation by the U.S. Strategic 
Bombing Survey in Germany and Japan; 
Britain was not included in the scope of the 
study. 

After the war, the Air Force, desiring a more 
complete coverage of psychological aspects of 
air warfare, contracted with the Rand Cor- 
poration to review the literature on the sub- 
ject, including British studies and the pro- 
tocols of the U. S. Strategic Bombing Survey 
reports on Germany and Japan. Prof. Janis’ 
book is the result. In Part I he dispels some 
popular illusions about reactions to A-bombs 
among the survivors at Hiroshima ‘and 
Nagasaki. There was psychological unpre- 
paredness for the explosion and resultant non- 
adaptive behavior as an immediate reaction. 
Though personal involvement was more wide- 
spread, emotional disturbances were not 
markedly more severe than acute anxiety and 
depression noted among British and German 
populations after severe raids of conventional 
bémbing. Prof. Janis continues, ““The amount 
of defeatism at Hiroshima and Nagasaki was 
less than in other Japanese cities . . . . 
The attitudes of the A-bombed population 
were found to resemble those of people in the 
lightly bombed and unbombed cities rather 
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than in the heavily bombed cities . . . 
(p. 60) and “the dominant psychological 
effects resulting from A-bomb disaster gener- 
ally did not differ in any unique way from 
those produced by other types of bombing 
disasters” (p. 71). 

As to reactions to conventional bombing, 
“mental breakdown, panic and mass demorali- 
zation rarely materialized” (p. 153). Chronic 
mental disorders notably increased only among 
those having phobias to loud noises, darkness, 
fire, and danger. Psychosomatic disorders 
were not numerous. Individual and group 
adaptive mechanisms absorbed most shocks 
and emotional reactions to bombing. 

On the other hand, widespread emotional 
stress resulted from deprivation caused by 
bombings. Inadequate food and _ sanitary 
facilities, breakdown of transportation and 
public utilities, lack of retaliation against 
the continuing air raids all caused bitter re- 
sentment against home authorities for failure 
to provide protection. Lowered morale be- 
came apparent as crime and delinquency rates, 
black-marketing, and other symptoms of 
social disorganization increased. Gradually 
apathy and defeatism developed into defection. 

In conclusion, Prof. Janis warns that it can 
happen here, that realistic education to the 
human factor problems posed by the H-bomb, 
radiation poisoning and biological warfare is 
needed; that there must be a greater aware- 
ness of “‘group identification as a major factor 
underlying efficient performance in the face 
of danger” (p. 214). 

This is more than a psychologically oriented 
air warfare review of literature and data. It 
is a provocative glimpse into the future. 
Psychologists particularly will find it challeng- 
ing and worthy of study. 


Milton D. Graham 


Human Resources Committee, 
Research and Development Board, 
Washington 25, D.C. 


Rogers, C. R. Client-centered therapy. Boston: 
Houghton Mifflin Co., 1951. Pp. 
560. $4.00. 


vii + 


Dr. 


This latest volume from the prolific 
Rogers is a systematic and inclusive descrip- 
tion of nondirective therapy, as currently con- 
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ceived. Part I presents a “current view,” 
Part II, “the application,” and a briefer Part 
III, “implications for psychological theory.” 
In the “application” unit, Elaine Dorfman has 
contributed a chapter on “Play Therapy,” 
Nicholas Hobbs, a chapter on “Group- 
centered psychotherapy,” and Thomas 
Gordon, “group-centered teadership and ad- 
ministration.” Gordon’s chapter is distin- 
guished by its extended and varied refer- 
ences, and by its willingness, at this stage of 
knowledge to accede flexibly to demands of 
practical situations. 

In Client-Centered Therapy Carl Rogers gives 
further evidence of his profound faith in the 
ability of the individual to solve his own 
problems. His present “‘theoretical” position 
is that the well-adjusted individual is one 
whose self-structure can assimilate and_ in- 
clude perceived experiences without threat. 
Many individuals, however, seek therapy be- 
cause of the unsuccessful attempt of the self- 
structure to defend itself by rejection of those 
experiences which are inconsistent with the 
individual’s conception of himself. If the 
counselor can indicate to the client unre- 
served acceptance and accurate understand- 
ing of the client’s attitudes and perceptions, 
the client is permitted to become aware of and 
to integrate these previously “denied ex- 
periences” because they become gradually less 
threatening to the self. 

Much of Rogers’ message is buttressed by 
evidence from numerous researches of present 
and former students and by a wealth of illustra- 
tive excerpts which are taken verbatim from 
actual counseling interviews. Out of his con- 
viction and an intimate, empirical acquaint- 
ance with therapy, he evolves 19 propositions, 
constituting the bulk of his last chapter, ‘‘a 
theory of personality and behavior.” 

For the personnel worker, the strength of 
Client-Centered Therapy probably lies in the co- 
herent system which guides the interactions of 
counselor and client: the central “hypothesis” 
of nondirective therapy. Its fallibility ap- 
pears to reside in the fact that many of the 
underlying constructs upon which the “hy- 
pothesis” is based seem to be intuitively rather 
than empirically derived. For example, ‘the 
phenomenal field,” “the self” or “‘threat’’ can- 
not, to my knowledge, be directly observed, 
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but only inferred. One wonders whether 
Rogers’ own basic distrust of empiricism in 
data-gathering and theory construction has 
impelled him to state (Proposition VII, p. 494) 
that “The best vantage point for understand- 
ing behavior is from the internal frame of 
reference of the individual himself.” Perhaps 
it is this distrust that prevents Rogers from 
analyzing with meticulous care much of the 
research data which he presents in support of 
his arguments. 

Personnel workers in general, especially 
those engaged in counseling activities, would 
do well to become familiar with the contents 
of this book. Just as Strong and his co- 
workers have contributed materially to our 
knowledge of interests and their measurement 
through a combination of singleness of pur- 
pose with extensive research and writing over 
a period of years, so Rogers and his students 
have added to our knowledge about counseling 
in the past decade. Careful reading of Client- 
Centered Therapy cannot fail to stimulate the 
personnel worker in the direction of asking 
himself questions about what he is doing, what 
he knows and does not know. In some ways 
Rogers is not unlike Paracelsus who strove 


mightily 450 years ago to answer questions 
about man in his universe with meager data 
and inadequate conceptions available to him. 
\s in the case of Paracelsus, Rogers’ latest 
book will probably be enthusiastically ac- 
cepted by some, violently rejected by others, 
casually received by few. 


Harold B. Pepinsky 


Occupational Op portunities Service, 
The Ohio State University 


Bryan, Alice [., The public librarian (With a 
section on the education of librarians by 
Robert D. Leigh). New York: Columbia 
University Press, 1952. Pp. 474. $6.00. 
rhis volume completes the series of studies 

of public libraries made by the Public Library 

Inquiry of the Social Science Research Council 

and directed by Robert D. Leigh. It consists 

of Parts 1-3 which contain Dr. Bryan’s survey 
of public library personnel and library person- 

nel organizations and administration; Part 4, 

which is a survey of the education of librarians 

(Dr. Bryan designed the survey and deter- 
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mined its method, though the execution was 
undertaken by Dr. Leigh); and, Part 5 which 
is the summary and conclusions for both 
surveys. 

Dr. Bryan has done a workmanlike job in 
presenting and analyzing the information ob- 
tained from questionnaires and tests given to 
3,706 librarians. In addition she has sup- 
plemented her data in some instances with other 
data. The data on personnel organization 
and administration were obtained by a fifty- 
six page questionnaire supplemented by 
personal visits to forty-three of the sixty 
libraries in the sample. 

In analyzing the professional librarian Dr. 
Bryan studied personal characteristics (age, 
sex, marriage, personality revealed by the 
Guilford-Martin Inventory of Factors, recre- 
ation, etc.), Educational status (academic, 
professional, non-credit training, etc.), Eco- 
nomic status (salaries, promotion, personal 
savings, insurance, retirement, etc.) and the 
Library Career (vocational interests as meas- 
ured by the Strong Vocational Interest Blank, 
present attitudes toward librarianship, at- 
tendance at professional meetings, professional 
reading, etc.). All in all this forms without 
question the most comprehensive picture of 
what the librarian is like, what he (or as Dr. 
Bryan aptly points out she) earns, and how 
well librarians are prepared to meet the 
library’s objectives. It is unfortunate that 
this study appears in 1952, was written just a 
year ago and based on information obtained 
in 1947 and 1948. As a result some of the in- 
formation presented, e.g., information on 
salaries, is not representative of the present 
time. And in interpreting the results the 
reader must bear this fact in mind although 
the author in several places points this out. 

In the section on personnel administration 
Dr. Bryan presents detailed findings on how 
libraries handle their personnel problems. 
Chapters on personnel management, employee 
selection, classification, in-service training, em- 
ployee welfare and morale, etc. present again 
the most comprehensive picture we have of 
library practices in the area of personnel ad- 
ministration. The conclusion that Dr. Bryan 
reaches is that personnel in public libraries is 
inadequately organized and supervised in 
terms of modern, scientific personnel manage- 
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ment. With this conclusion, the careful 
reader must agree for Dr. Bryan’s data are 
complete and reliable. One feels at times 
however that she places too much emphasis on 
formal personnel procedures since many of 
the libraries surveyed were small ones (it 
appears that 20 of the libraries averaged less 
than 5 staff members apiece) where formal 
devices are less important than human, com- 
petent and discriminating chief librarians who 
use humanitarian principles in dealing with 
their few staff members. This is in contrast 
to the section on the librarian where in addition 
to Dr. Bryan’s detailed facts one seems to re- 
ceive some feeling of the character and person- 
ality of librarians. 

Dr. Leigh’s section on the education of the 
librarian gives information on the evaluation 
of library schools, their educational programs, 
the students and_the faculty and instructional 
resources. The data were obtained by ques- 
tionnaires to the thirty-four accredited library 
schools in the U. S. 

Here again a complete picture is presented 
of library education in the U.S. In addition 
Dr. Leigh’s study profits greatly from the fact 
that previous studies of library schools enabled 
the present data to be compared with the 
earlier figures and thus trends could be asses- 
sed. Dr. Leigh’s study however gives more 
complete information than any of the others 
cited for earlier comparison. 

Dr. Leigh’s findings are in brief that there 
are inadequacies in the library schools, which 
are primarily the result of great disparities in 
resources among the schools themselves. He 
suggests that the way of improvement lies in 
the consolidation of facilities in the 
stantial number of strong library schools. 

The two sections present interesting similat- 
ities and interesting differences. Both Dr. 
Bryan’s section on personnel and Dr. Leigh’s 
section on the education of librarians are well 
planned and well presented, the evidence col- 
lected is pertinent, it is summarized carefully 
and completely. In both instances we have 
the most complete picture available today. lh 
both studies there are some interpretations 
that one might question but such instances 
are few. 

The chief differences in the two sections are 
in respect to breadth and depth. Dr. Leigh’s 


sub- 
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study seems to be broader in that it makes 
much greater use of previous studies both of 
library schools in general and of individual 
schools. Dr. Bryan’s study is almost entirely 
limited to the presentation and 
of the facts obtained. in analyzing 
the 


results 


analysis 
Even 


she makes littie use of other 


articles or books on library personnel ai 

ministration, ; : 
To this reviewer at least Dr. Leigh’s analyses 

and interpretations seem more penetrating. 


The discussion of library education seems to 
to have much more warmth, much more care 
and thought and more evidence of insight. 
Both however maintain the same high stand- 
ards of the six volumes of the Public Library 
Inquiry previously published and the volume 
as a whole is a valuable addition to library 
literature. 

Errett W. 


Dean, College of Science, Literature and the Arts, 
University of Minnesota 


McDiarmid 


Riley, John W., Ryan, Bryce F., and Lifshitz, 
Marcia. The student looks at his teacher. 
New Brunswick, New Jersey: Rutgers Uni 
versity Press, 1950. Pp. iv+166. $2.75 
This is a report of a single, but extensive, 

study made at Brooklyn College by the Soci 

ology Department at Rutgers. Of the regu- 
larly enrolled Brooklyn College day students, 

6,681 out of a possible 8,000 answered on one 

day an extensive questionnaire and deposited 

the results in a box anonymously. 
analyzes the returns. 

The authors make a telling case a priori for 
the study of evaluation of teaching through 
student opinion. They point out that college 
teachers are well protected by tradition and 
rationalization from facing evaluation of any 
objective kind. They do not have the spur 
to improvement that is furnished by knowledge 
of success or failure. 


The be vi rk 


Teachers are selected for 
their training and research but not for success 
asateacher. Too often promotion also is inde 
pendent of teaching performance. In modern, 
large universities, the diagnostic effect of stu- 
dent election of courses is lost. Fellow faculty 
members do not visit each others’ classes and 
depend largely on student gossip for their 


evaluations of each other. 
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It is, of course, entirely too much to expect 
that a single study, limited to its advance 
program, should supply the answers to the 
questions raised. Answers can come only as 
a result of long experience and of many ap- 
proaches. Where shall we seek evaluations 
of teaching? From students, from colleagues, 
from past students, from administrators? How 
shall judgments be collected? To whom shall 
they be made available? What is their value? 

The authors have assumed that the answer 
to the question of the best source of evaluative 
judgments is ‘‘the students.”’ There are cogent 
arguments for this. Students are the only 
persons who observe teaching. They experi- 
ence it as well as observe it. Teaching is a 
two-way operation and must be participated 
in by students or there is nothing taught. 

The survey of which the book is a report and 
analysis made use of a questionnaire listing ten 
items important to good teaching. These were 
selected by the staff after reading the literature 
of evaluation and making their own additions 
and talking over the items with students. 
The ten traits were: (1) organization of subject 
matter; (2) speaking ability; (3) ability to 
explain; (4) encouragement to thinking; (5) 
attitude toward student; (6) knowledge of sub- 
ject; (7) attitude toward subject; (8) fairness 
in examinations; (9) tolerance to disagreement; 
and (10) instructor as “human being.” For 
each trait, four degrees were described. In 
the case of trait 5, for example, the extremes 
of the four degrees were described as: (a) 
sympathetic, helpful, actively concerned; and 
(b) distant, aloof, cold. By this device, the 
authors believe they were avoiding encouraging 
ratings on a comparative basis (Professor X 
as compared with Professor Z); they preferred 
to imply an absolute scale. 

Students were asked possible relevant items, 
concerning the size of the class, their own grade 
point, whether the course taught was required 
Each student was asked 
to rate one of his instructors. The one chosen 
depended upon the last initial of the student 


or élective, and so on. 


and the serial order of the class in the weekly 
schedule. 


Findings in individual cases were 
reported in percentiles for each trait, based on 
the distribution (teachers of art, science, and 
social science taken separately). 
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The authors were not interested in the evalu- 
uation of the teaching of individuals, although 
each teacher was given the returns in his own 
case, indicating his percentile standing in each 
trait. No determinations of the reliability of 
these percentile scores were sought or reported. 

The authors’ main ‘attention is given to the 
association of “‘traits’’ with such items as age, 
rank, student grade, student year in college, 
size of class, and field of study (art, natural 
sciénce, or social science). Importance is at- 
tributed to the higher scores made by teachers 
on “knowledge of the subject” rather than on 
“encouragement to thinking,” and to the 
influence from this fact that student judgments 
are in terms of an ideal norm. 

Students’ ratings of instructors are little 
affected by size of class, by the required or 
elective character of a course, or by the year 
in college. Value as a teacher appeared to 
diminish with the age of the teacher and with 
advancing rank. . Value is favorably associated 
with the possession of a Ph.D. and by the 
publication of research. 

The report will be valuable to anyone inter- 
ested in the evaluation of teaching but it is 
disappointing in that the study was made 
almost without statistical analysis. The style 
of the book is reminiscent of federal agency 
reports, with the frequent use of such terms as 
“implement” to avoid being too precise. 

E. R. Guthrie 


University of Washington 
Fuess, Claude M. The College Board: Its first 
fifty years. New York: Columbia University 

Press, 1950. Pp. vi+ 222. $2.75. 

The development of educational measure- 
ment in the United States has been an outgrowth 
of the insight and skill of many individual 
reasearch leaders, the combined effort of faculty 
members in a number of universities, the work 
of various governmental agencies including 
especially the Armed Forces, and the contri- 
butions of several institutions specializing in 
tests and examinations. Among Eastern col- 
leges and preparatory schools, probably no 
institution has played a larger part in measure- 
ment theory and practice than the College 
Entrance Examination Board. In recent years, 
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this influence has been extended to 
regions as well. 

The College Board by Claude M. Fuess pro- 
vides an intimate, detailed, and highly readable 
account of the first fifty years of the Board’s 
organization, plans, and work. Perhaps no 
one was better qualified to write a book of this 
kind. As headmaster of Phillips Academy and 
as a leader in the independent school field, 
Dr. Fuess has been closely identified with the 
group of men and women who built the Board, 
a fact which he modestly overlooks in his book. 

Dr. Fuess shows how the idea of a college 
board was born out of the need to correct the 
chaotic college entrance situation that prevailed 
during the latter part of the nineteenth century 
when each college prescribed its own entrance 
requirements without regard to what other 
colleges were doing. He then traces the devel- 
opment of the Board from its early organization 
down to the latest phase when it merged the 
operation of its testing activities with those of 
the Carnegie Foundation for the Advancement 
of Teaching and the American Council on 
Education to form the Educational Testing 
Service. 


other 


The book will be of more interest to educators 
than to psychologists. There are nine chapters 
in the book. The chapter on early organiza- 
tion is a particularly interesting and valuable 
contribution, not alone for its record of the 
formation of the Board, but also for the light 
it sheds upon two great and very different 
personalities in higher education who joined 
forces to establish the Board—Charles William 
Eliot and Nicholas Murray Butler. 

Other chapters deal with the Board in action, 
the move toward comprehensive examinations, 
aptitude tests, problems and personalities, and 
the work of the Board during World War II 


and following the war. The book concludes 


with a brief chapter discussing the question of 
what lies ahead. 


In several chapters there is 
considerable detail concerning personalities well 
known in Board circles but perhaps of less 
interest to a wider reading public. But this 
kind of detail helps to create in the reader a 
feeling for the Board as an on-going organiza- 
tion. 

Although there are occasional references to 
the work of measurement leaders outside the 
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Board, such as Thorndike, Bingharh, and 
Walter Dill Scott, the development of the 
Board’s examinations is treated largely as a 
self-contained project. In point of time, the 
Board’s history closely parallels the history of 
the measurement movement, and inevitably 
Board policy and the nature of its examinations 
were influenced by the activity and ferment 
taking place in educational measurement at 
all school levels throughout the country. How- 
ever, The College Board was written for a special 
purpose, and it could hardly be expected that 
it would deal with the history of the whole 
field of education surement. 

The style of 3’s book, unlike that of 
many books in id of education, makes 
for pleasurable, as well as profitable, reading. 
The book will be of interest and help to all who 
wish to have at hand a lively and accurate 
record of the first fifty years of an influential 
organization that has served institutions well 
and that may be expected to provide continued 
leadership and service of a higher order in the 
years to come. 

Arthur E. Traxler 

Educational Records Bureau, 

New York City 
Hersey, Rexford. Better foremanship—key {o 
profitable management. New York: Conover- 

Mast Publications, Inc., 1951. Pp. 244. 

$4.00. 

This book is largely a collection of articles 
previously published by the author in Mill and 
Factory, Personnel, and Personnel Journal. It 
is intended for the foreman, “. . . give him the 
working tools of his profession, a basic concep- 
tion of how to handle them, and a practical 
concept of his day-to-day job.” 

The book deals with the foreman’s duties 
and responsibilities in the role of a leader, a 
practical psychologist, an administrator, a job 
analyst, an instructor, a safety engineer, and an 
executive. The last two chapters are directed 
to executives above the foreman level and deal 
with higher management’s function in develop- 
ing and maintaining better supervisors. There 
is a 56-page appendix consisting of a checklist 
for rating or self-analysis of foremen, and two 
questionnaires dealing with knowledge and 
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principles involved in supervision, complete 
with scoring keys. 

The author does a complete job of covering 
in one volume most of the many and varied 
functions which make up the complex job of the 
present-day foreman. This complete cover- 
age, however, results in one of the main weak- 
nesses of the book. In order to cover so much 
material, the author has had to limit his discus- 
sion of a number of the subjects covered to a 
bare listing of rules-of-thumb for the foreman 
tofollow. Many of these rules are stated flatly, 
with little or no explanation of the “‘why’s”’ 
behind them. This is especially true in the 
case of the treatment of the “human relations” 
phase of the supervisor’s job. This type of 


presentation creates the impression that a 
simple following of these rules-of-thumb is all 
it takes to become a successful and competent 
In fact, on page 14 we find the 
statement, “However, the Leader, who has 
followed the techniques laid down previously 


foreman. 


in this chapter need not worry about dissatis- 
faction in his group.” 

The book is written in a clear and concise 
style, with occasional examples and illustra- 
tions. Its use with foremen, however, will be 
limited somewhat because much of the vocabu- 
lary used is at too high a level to be understood 
by persons without a fairly extensive educa- 
tional background. 

Because the book contains so much diversi- 
fied material—all of which should be included 
in a complete program of supervisory develop- 
ment—it should prove useful as a textbook 
supplement for the conference type of super- 
visor training. A discussion of the missing 
“why’s’”’ behind the many rules laid down in 
the book alone could well serve as the basis 
for a profitable series of training conferences. 


Theodore R. Lindbom 
Personnel Department, 
Midland Co-operative W holesale, 
Minneapolis, Minnesota 
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Vocabulary, semantics and intelligence. Snowden Ar- 
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191. $3.00. 
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The Ames 


Demonstrations 
in Perception 


By WILLIAM ITTELSON 


E famous demonstrations in perception developed 
by Adelbert Ames of Hanover are here collected, 
pictured, and fully described for the first time. By in- 
genious photographs and drawings, the psychological 
effects are depicted and the construction of the appa- 
ratus shown. Since the theoretical interpretation of 


these demonstrations is still a matter of controversy, the 


treatment is factual throughout. 
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RESOLUTION CHART 














i. 


= 


100 MILLIMETERS 


INSTRUCTIONS Resolution is expressed in terms of the lines per millimeter recorded by a particular 
film under specified conditions. Numerals in chart indicate the number of lines per millimeter in adjacent 
“T-shaped” groupings. 

In microfilming, it is necessary to determine the reduction ratio and multiply the number of lines in the 
chart by this value to find the number of lines recorded by the film. As an aid in determining the reduction 
ratio, the line above is 100 millimeters in length. Measuring this line in the film image and dividing the length 
into 100 gives the reduction ratio. ample: the line is 20 mm. long in the film image, and 100/20 ‘. 


Examine “T-shaped” line groupings in the film with microscope, and note the number adjacent to finest 
lines recorded sharply and distinctly. Multiply this number by the reduction factor to obtain resolving power 
in lines per millimeter. Example: 7.9 group of lines is clearly recorded while lines in the 10.0 group are 
not distinctly separated. Reduction ratio is 5, and 7.9 x § 39.5 lines per millimeter recorded satisfacto- 
rily. 10.0 x § §0 lines per millimeter which are not recorded satisfactorily. Under the particular condi- 
tions, maximum resolution is between 39.5 and 50 lines per millimeter. 

Resolution, as measured on the film, is a test of the entire photographic system, including lens, exposure, 
processing, and other factors. These rarely utilize maximum resolution of the film. Vibrations during 
exposure, lack of critical focus, and exposures yielding very dense negatives are to be avoided. 
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